Developing an AI application¶

Going forward, AI algorithms will be incorporated into more and more everyday applications. For example, you might want to include an image classifier in a smart phone app. To do this, you'd use a deep learning model trained on hundreds of thousands of images as part of the overall application architecture. A large part of software development in the future will be using these types of models as common parts of applications.

In this project, you'll train an image classifier to recognize different species of flowers. You can imagine using something like this in a phone app that tells you the name of the flower your camera is looking at. In practice you'd train this classifier, then export it for use in your application. We'll be using this dataset of 102 flower categories, you can see a few examples below.

No description has been provided for this image

The project is broken down into multiple steps:

  • Load and preprocess the image dataset
  • Train the image classifier on your dataset
  • Use the trained classifier to predict image content

We'll lead you through each part which you'll implement in Python.

When you've completed this project, you'll have an application that can be trained on any set of labeled images. Here your network will be learning about flowers and end up as a command line application. But, what you do with your new skills depends on your imagination and effort in building a dataset. For example, imagine an app where you take a picture of a car, it tells you what the make and model is, then looks up information about it. Go build your own dataset and make something new.

First up is importing the packages you'll need. It's good practice to keep all the imports at the beginning of your code. As you work through this notebook and find you need to import a package, make sure to add the import up here.

In [ ]:
# Imports here
%matplotlib inline
%config InlineBackend.figure_format = 'retina'

import matplotlib.pyplot as plt

import torch
import numpy as np
from torch import nn
from torch import optim
from torchvision import datasets, transforms, models
import torch.nn.functional as F
from collections import OrderedDict

Load the data¶

Here you'll use torchvision to load the data (documentation). The data should be included alongside this notebook, otherwise you can download it here. The dataset is split into three parts, training, validation, and testing. For the training, you'll want to apply transformations such as random scaling, cropping, and flipping. This will help the network generalize leading to better performance. You'll also need to make sure the input data is resized to 224x224 pixels as required by the pre-trained networks.

The validation and testing sets are used to measure the model's performance on data it hasn't seen yet. For this you don't want any scaling or rotation transformations, but you'll need to resize then crop the images to the appropriate size.

The pre-trained networks you'll use were trained on the ImageNet dataset where each color channel was normalized separately. For all three sets you'll need to normalize the means and standard deviations of the images to what the network expects. For the means, it's [0.485, 0.456, 0.406] and for the standard deviations [0.229, 0.224, 0.225], calculated from the ImageNet images. These values will shift each color channel to be centered at 0 and range from -1 to 1.

In [86]:
data_dir = 'flowers'
train_dir = data_dir + '/train'
valid_dir = data_dir + '/valid'
test_dir = data_dir + '/test'
In [87]:
# TODO: Define your transforms for the training, validation, and testing sets
normalize_transforms = transforms.Normalize(mean=[0.485, 0.456, 0.406],
                                            std=[0.229, 0.224, 0.225])

data_transforms = {
    'train': transforms.Compose([transforms.RandomRotation(30),
                                transforms.RandomResizedCrop(224),
                                transforms.RandomHorizontalFlip(),
                                transforms.ToTensor(),
                                normalize_transforms]),
    'test': transforms.Compose([transforms.Resize(255),
                                transforms.CenterCrop(224),
                                transforms.ToTensor(),
                                normalize_transforms]),
    'valid': transforms.Compose([transforms.Resize(255),
                                transforms.CenterCrop(224),
                                transforms.ToTensor(),
                                normalize_transforms])
}

# TODO: Load the datasets with ImageFolder
image_datasets = {
    'train': datasets.ImageFolder(train_dir, transform=data_transforms['train']),
    'test': datasets.ImageFolder(test_dir, transform=data_transforms['test']),
    'valid': datasets.ImageFolder(valid_dir, transform=data_transforms['valid'])
}

# TODO: Using the image datasets and the trainforms, define the dataloaders
dataloaders = {
    'train': torch.utils.data.DataLoader(image_datasets['train'], batch_size=32, shuffle=True),
    'test': torch.utils.data.DataLoader(image_datasets['test'], batch_size=32, shuffle=True),
    'valid': torch.utils.data.DataLoader(image_datasets['valid'], batch_size=32, shuffle=True),
}

Label mapping¶

You'll also need to load in a mapping from category label to category name. You can find this in the file cat_to_name.json. It's a JSON object which you can read in with the json module. This will give you a dictionary mapping the integer encoded categories to the actual names of the flowers.

In [91]:
import json

with open('cat_to_name.json', 'r') as f:
    cat_to_name = json.load(f)

Building and training the classifier¶

Now that the data is ready, it's time to build and train the classifier. As usual, you should use one of the pretrained models from torchvision.models to get the image features. Build and train a new feed-forward classifier using those features.

We're going to leave this part up to you. Refer to the rubric for guidance on successfully completing this section. Things you'll need to do:

  • Load a pre-trained network (If you need a starting point, the VGG networks work great and are straightforward to use)
  • Define a new, untrained feed-forward network as a classifier, using ReLU activations and dropout
  • Train the classifier layers using backpropagation using the pre-trained network to get the features
  • Track the loss and accuracy on the validation set to determine the best hyperparameters

We've left a cell open for you below, but use as many as you need. Our advice is to break the problem up into smaller parts you can run separately. Check that each part is doing what you expect, then move on to the next. You'll likely find that as you work through each part, you'll need to go back and modify your previous code. This is totally normal!

When training make sure you're updating only the weights of the feed-forward network. You should be able to get the validation accuracy above 70% if you build everything right. Make sure to try different hyperparameters (learning rate, units in the classifier, epochs, etc) to find the best model. Save those hyperparameters to use as default values in the next part of the project.

One last important tip if you're using the workspace to run your code: To avoid having your workspace disconnect during the long-running tasks in this notebook, please read in the earlier page in this lesson called Intro to GPU Workspaces about Keeping Your Session Active. You'll want to include code from the workspace_utils.py module.

Note for Workspace users: If your network is over 1 GB when saved as a checkpoint, there might be issues with saving backups in your workspace. Typically this happens with wide dense layers after the convolutional layers. If your saved checkpoint is larger than 1 GB (you can open a terminal and check with ls -lh), you should reduce the size of your hidden layers and train again.

In [138]:
# TODO: Build and train your network
model = models.vgg16(pretrained=True)
model
/usr/local/lib/python3.9/site-packages/torchvision/models/_utils.py:208: UserWarning: The parameter 'pretrained' is deprecated since 0.13 and may be removed in the future, please use 'weights' instead.
  warnings.warn(
/usr/local/lib/python3.9/site-packages/torchvision/models/_utils.py:223: UserWarning: Arguments other than a weight enum or `None` for 'weights' are deprecated since 0.13 and may be removed in the future. The current behavior is equivalent to passing `weights=VGG16_Weights.IMAGENET1K_V1`. You can also use `weights=VGG16_Weights.DEFAULT` to get the most up-to-date weights.
  warnings.warn(msg)
Out[138]:
VGG(
  (features): Sequential(
    (0): Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
    (1): ReLU(inplace=True)
    (2): Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
    (3): ReLU(inplace=True)
    (4): MaxPool2d(kernel_size=2, stride=2, padding=0, dilation=1, ceil_mode=False)
    (5): Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
    (6): ReLU(inplace=True)
    (7): Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
    (8): ReLU(inplace=True)
    (9): MaxPool2d(kernel_size=2, stride=2, padding=0, dilation=1, ceil_mode=False)
    (10): Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
    (11): ReLU(inplace=True)
    (12): Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
    (13): ReLU(inplace=True)
    (14): Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
    (15): ReLU(inplace=True)
    (16): MaxPool2d(kernel_size=2, stride=2, padding=0, dilation=1, ceil_mode=False)
    (17): Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
    (18): ReLU(inplace=True)
    (19): Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
    (20): ReLU(inplace=True)
    (21): Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
    (22): ReLU(inplace=True)
    (23): MaxPool2d(kernel_size=2, stride=2, padding=0, dilation=1, ceil_mode=False)
    (24): Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
    (25): ReLU(inplace=True)
    (26): Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
    (27): ReLU(inplace=True)
    (28): Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
    (29): ReLU(inplace=True)
    (30): MaxPool2d(kernel_size=2, stride=2, padding=0, dilation=1, ceil_mode=False)
  )
  (avgpool): AdaptiveAvgPool2d(output_size=(7, 7))
  (classifier): Sequential(
    (0): Linear(in_features=25088, out_features=4096, bias=True)
    (1): ReLU(inplace=True)
    (2): Dropout(p=0.5, inplace=False)
    (3): Linear(in_features=4096, out_features=4096, bias=True)
    (4): ReLU(inplace=True)
    (5): Dropout(p=0.5, inplace=False)
    (6): Linear(in_features=4096, out_features=1000, bias=True)
  )
)
In [93]:
model.class_to_idx = image_datasets['train'].class_to_idx
In [94]:
device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
In [95]:
for param in model.parameters():
    param.requires_grad = False

classifier = nn.Sequential(OrderedDict([
    ('fc1', nn.Linear(25088, 4096)),
    ('relu', nn.ReLU()),
    ('dropout', nn.Dropout(p=0.2, inplace=False)),
    ('fc2', nn.Linear(4096, 2048)),
    ('relu2', nn.ReLU()),
    ('dropout2', nn.Dropout(p=0.5, inplace=False)),
    ('fc3', nn.Linear(2048, 102)),
    ('output', nn.LogSoftmax(dim=1))
]))

model.classifier = classifier
model
Out[95]:
VGG(
  (features): Sequential(
    (0): Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
    (1): ReLU(inplace=True)
    (2): Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
    (3): ReLU(inplace=True)
    (4): MaxPool2d(kernel_size=2, stride=2, padding=0, dilation=1, ceil_mode=False)
    (5): Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
    (6): ReLU(inplace=True)
    (7): Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
    (8): ReLU(inplace=True)
    (9): MaxPool2d(kernel_size=2, stride=2, padding=0, dilation=1, ceil_mode=False)
    (10): Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
    (11): ReLU(inplace=True)
    (12): Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
    (13): ReLU(inplace=True)
    (14): Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
    (15): ReLU(inplace=True)
    (16): MaxPool2d(kernel_size=2, stride=2, padding=0, dilation=1, ceil_mode=False)
    (17): Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
    (18): ReLU(inplace=True)
    (19): Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
    (20): ReLU(inplace=True)
    (21): Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
    (22): ReLU(inplace=True)
    (23): MaxPool2d(kernel_size=2, stride=2, padding=0, dilation=1, ceil_mode=False)
    (24): Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
    (25): ReLU(inplace=True)
    (26): Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
    (27): ReLU(inplace=True)
    (28): Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
    (29): ReLU(inplace=True)
    (30): MaxPool2d(kernel_size=2, stride=2, padding=0, dilation=1, ceil_mode=False)
  )
  (avgpool): AdaptiveAvgPool2d(output_size=(7, 7))
  (classifier): Sequential(
    (fc1): Linear(in_features=25088, out_features=4096, bias=True)
    (relu): ReLU()
    (dropout): Dropout(p=0.2, inplace=False)
    (fc2): Linear(in_features=4096, out_features=2048, bias=True)
    (relu2): ReLU()
    (dropout2): Dropout(p=0.5, inplace=False)
    (fc3): Linear(in_features=2048, out_features=102, bias=True)
    (output): LogSoftmax(dim=1)
  )
)
In [96]:
criterion = nn.NLLLoss()
optimizer = optim.Adam(model.classifier.parameters(), lr=0.001)
print(device)
cpu

Developing an AI application¶

Going forward, AI algorithms will be incorporated into more and more everyday applications. For example, you might want to include an image classifier in a smart phone app. To do this, you'd use a deep learning model trained on hundreds of thousands of images as part of the overall application architecture. A large part of software development in the future will be using these types of models as common parts of applications.

In this project, you'll train an image classifier to recognize different species of flowers. You can imagine using something like this in a phone app that tells you the name of the flower your camera is looking at. In practice you'd train this classifier, then export it for use in your application. We'll be using this dataset of 102 flower categories, you can see a few examples below.

No description has been provided for this image

The project is broken down into multiple steps:

  • Load and preprocess the image dataset
  • Train the image classifier on your dataset
  • Use the trained classifier to predict image content

We'll lead you through each part which you'll implement in Python.

When you've completed this project, you'll have an application that can be trained on any set of labeled images. Here your network will be learning about flowers and end up as a command line application. But, what you do with your new skills depends on your imagination and effort in building a dataset. For example, imagine an app where you take a picture of a car, it tells you what the make and model is, then looks up information about it. Go build your own dataset and make something new.

First up is importing the packages you'll need. It's good practice to keep all the imports at the beginning of your code. As you work through this notebook and find you need to import a package, make sure to add the import up here.

Testing your network¶

It's good practice to test your trained network on test data, images the network has never seen either in training or validation. This will give you a good estimate for the model's performance on completely new images. Run the test images through the network and measure the accuracy, the same way you did validation. You should be able to reach around 70% accuracy on the test set if the model has been trained well.

In [97]:
# TODO: Do validation on the test set
counter = 0
epochs = 2
by_batches = 15

train_losses, test_losses = [], []
for e in range(epochs):
    running_train_loss = 0
    for images, labels in dataloaders['train']:
        counter += 1
        optimizer.zero_grad()

        output = model.forward(images)
        loss = criterion(output, labels)
        running_train_loss += loss.item()

        loss.backward()
        optimizer.step()

        if counter % by_batches == 0:
            valid_loss = 0
            test_correct = 0  # Number of correct predictions on the test set

            model.eval()

            # Turn off gradients for validation, saves memory and computations
            with torch.no_grad():
                for images, labels in dataloaders['test']:
                    images, labels = images.to(device), labels.to(device)

                    output = model.forward(images)
                    loss = criterion(output, labels)
                    valid_loss += loss.item()

                    ps = torch.exp(output)
                    top_p, top_class = ps.topk(1, dim=1)
                    equals = top_class == labels.view(*top_class.shape)
                    test_correct += equals.sum().item()

            # Get mean loss to enable comparison between train and test sets
            train_loss = running_train_loss / by_batches
            test_loss = valid_loss / len(dataloaders['valid'].dataset)

            # At completion of epoch
            train_losses.append(train_loss)
            test_losses.append(test_loss)

            print("Epoch: {}/{}.. ".format(e+1, epochs),
                  "Training Loss: {:.3f}.. ".format(train_loss),
                  "Test Loss: {:.3f}.. ".format(test_loss),
                  "Test Accuracy: {:.3f}".format(test_correct / len(dataloaders['test'].dataset)))
Epoch: 1/2..  Training Loss: 0.017..  Test Loss: 0.017..  Test Accuracy: 0.126
Epoch: 1/2..  Training Loss: 0.014..  Test Loss: 0.014..  Test Accuracy: 0.230
Epoch: 1/2..  Training Loss: 0.012..  Test Loss: 0.012..  Test Accuracy: 0.300
Epoch: 1/2..  Training Loss: 0.010..  Test Loss: 0.010..  Test Accuracy: 0.393
Epoch: 1/2..  Training Loss: 0.008..  Test Loss: 0.008..  Test Accuracy: 0.454
Epoch: 1/2..  Training Loss: 0.008..  Test Loss: 0.008..  Test Accuracy: 0.475
Epoch: 1/2..  Training Loss: 0.007..  Test Loss: 0.007..  Test Accuracy: 0.532
Epoch: 1/2..  Training Loss: 0.006..  Test Loss: 0.006..  Test Accuracy: 0.575
Epoch: 1/2..  Training Loss: 0.006..  Test Loss: 0.006..  Test Accuracy: 0.601
Epoch: 1/2..  Training Loss: 0.006..  Test Loss: 0.006..  Test Accuracy: 0.619
Epoch: 1/2..  Training Loss: 0.005..  Test Loss: 0.005..  Test Accuracy: 0.668
Epoch: 1/2..  Training Loss: 0.005..  Test Loss: 0.005..  Test Accuracy: 0.690
Epoch: 1/2..  Training Loss: 0.005..  Test Loss: 0.005..  Test Accuracy: 0.654
Epoch: 2/2..  Training Loss: 0.004..  Test Loss: 0.004..  Test Accuracy: 0.698
Epoch: 2/2..  Training Loss: 0.004..  Test Loss: 0.004..  Test Accuracy: 0.709
Epoch: 2/2..  Training Loss: 0.004..  Test Loss: 0.004..  Test Accuracy: 0.689
Epoch: 2/2..  Training Loss: 0.004..  Test Loss: 0.004..  Test Accuracy: 0.703
Epoch: 2/2..  Training Loss: 0.004..  Test Loss: 0.004..  Test Accuracy: 0.730
Epoch: 2/2..  Training Loss: 0.004..  Test Loss: 0.004..  Test Accuracy: 0.719
Epoch: 2/2..  Training Loss: 0.004..  Test Loss: 0.004..  Test Accuracy: 0.696
Epoch: 2/2..  Training Loss: 0.004..  Test Loss: 0.004..  Test Accuracy: 0.728
Epoch: 2/2..  Training Loss: 0.004..  Test Loss: 0.004..  Test Accuracy: 0.716
Epoch: 2/2..  Training Loss: 0.004..  Test Loss: 0.004..  Test Accuracy: 0.736
Epoch: 2/2..  Training Loss: 0.003..  Test Loss: 0.003..  Test Accuracy: 0.783
Epoch: 2/2..  Training Loss: 0.004..  Test Loss: 0.004..  Test Accuracy: 0.734
Epoch: 2/2..  Training Loss: 0.003..  Test Loss: 0.003..  Test Accuracy: 0.758
Epoch: 2/2..  Training Loss: 0.003..  Test Loss: 0.003..  Test Accuracy: 0.756

Save the checkpoint¶

Now that your network is trained, save the model so you can load it later for making predictions. You probably want to save other things such as the mapping of classes to indices which you get from one of the image datasets: image_datasets['train'].class_to_idx. You can attach this to the model as an attribute which makes inference easier later on.

model.class_to_idx = image_datasets['train'].class_to_idx

Remember that you'll want to completely rebuild the model later so you can use it for inference. Make sure to include any information you need in the checkpoint. If you want to load the model and keep training, you'll want to save the number of epochs as well as the optimizer state, optimizer.state_dict. You'll likely want to use this trained model in the next part of the project, so best to save it now.

In [107]:
# TODO: Save the checkpoint
model.class_to_idx = image_datasets['train'].class_to_idx
checkpoint = { 'model': 'vgg16',
               'epoch': epochs,
               'state_dict': model.state_dict(),
               'optimizer': optimizer.state_dict(),
               'class_to_idx': model.class_to_idx }

torch.save(checkpoint, 'checkpoint.pth')
In [104]:
model.class_to_idx
Out[104]:
{'1': 0,
 '10': 1,
 '100': 2,
 '101': 3,
 '102': 4,
 '11': 5,
 '12': 6,
 '13': 7,
 '14': 8,
 '15': 9,
 '16': 10,
 '17': 11,
 '18': 12,
 '19': 13,
 '2': 14,
 '20': 15,
 '21': 16,
 '22': 17,
 '23': 18,
 '24': 19,
 '25': 20,
 '26': 21,
 '27': 22,
 '28': 23,
 '29': 24,
 '3': 25,
 '30': 26,
 '31': 27,
 '32': 28,
 '33': 29,
 '34': 30,
 '35': 31,
 '36': 32,
 '37': 33,
 '38': 34,
 '39': 35,
 '4': 36,
 '40': 37,
 '41': 38,
 '42': 39,
 '43': 40,
 '44': 41,
 '45': 42,
 '46': 43,
 '47': 44,
 '48': 45,
 '49': 46,
 '5': 47,
 '50': 48,
 '51': 49,
 '52': 50,
 '53': 51,
 '54': 52,
 '55': 53,
 '56': 54,
 '57': 55,
 '58': 56,
 '59': 57,
 '6': 58,
 '60': 59,
 '61': 60,
 '62': 61,
 '63': 62,
 '64': 63,
 '65': 64,
 '66': 65,
 '67': 66,
 '68': 67,
 '69': 68,
 '7': 69,
 '70': 70,
 '71': 71,
 '72': 72,
 '73': 73,
 '74': 74,
 '75': 75,
 '76': 76,
 '77': 77,
 '78': 78,
 '79': 79,
 '8': 80,
 '80': 81,
 '81': 82,
 '82': 83,
 '83': 84,
 '84': 85,
 '85': 86,
 '86': 87,
 '87': 88,
 '88': 89,
 '89': 90,
 '9': 91,
 '90': 92,
 '91': 93,
 '92': 94,
 '93': 95,
 '94': 96,
 '95': 97,
 '96': 98,
 '97': 99,
 '98': 100,
 '99': 101}

Loading the checkpoint¶

At this point it's good to write a function that can load a checkpoint and rebuild the model. That way you can come back to this project and keep working on it without having to retrain the network.

In [112]:
# TODO: Write a function that loads a checkpoint and rebuilds the model
def load_checkpoint(filepath):
    checkpoint = torch.load(filepath)
    print(checkpoint)
    model = models.vgg16(pretrained=True)

    for param in model.parameters():
        param.requires_grad = False
    model.classifier = classifier
    model.load_state_dict(checkpoint['state_dict'])
    print(checkpoint['class_to_idx'])
    model.class_to_idx = checkpoint['class_to_idx']

    optimizer = optim.Adam(model.classifier.parameters(), lr=0.001)
    optimizer_for_model = optimizer.load_state_dict(state_dict=checkpoint['optimizer'])
    return model, optimizer_for_model
In [114]:
model2, optimizer2 = load_checkpoint('checkpoint.pth')
print(model2)
{'model': 'vgg16', 'epoch': 2, 'state_dict': OrderedDict([('features.0.weight', tensor([[[[-5.5373e-01,  1.4270e-01,  5.2896e-01],
          [-5.8312e-01,  3.5655e-01,  7.6566e-01],
          [-6.9022e-01, -4.8019e-02,  4.8409e-01]],

         [[ 1.7548e-01,  9.8630e-03, -8.1413e-02],
          [ 4.4089e-02, -7.0323e-02, -2.6035e-01],
          [ 1.3239e-01, -1.7279e-01, -1.3226e-01]],

         [[ 3.1303e-01, -1.6591e-01, -4.2752e-01],
          [ 4.7519e-01, -8.2677e-02, -4.8700e-01],
          [ 6.3203e-01,  1.9308e-02, -2.7753e-01]]],


        [[[ 2.3254e-01,  1.2666e-01,  1.8605e-01],
          [-4.2805e-01, -2.4349e-01,  2.4628e-01],
          [-2.5066e-01,  1.4177e-01, -5.4864e-03]],

         [[-1.4076e-01, -2.1903e-01,  1.5041e-01],
          [-8.4127e-01, -3.5176e-01,  5.6398e-01],
          [-2.4194e-01,  5.1928e-01,  5.3915e-01]],

         [[-3.1432e-01, -3.7048e-01, -1.3094e-01],
          [-4.7144e-01, -1.5503e-01,  3.4589e-01],
          [ 5.4384e-02,  5.8683e-01,  4.9580e-01]]],


        [[[ 1.7715e-01,  5.2149e-01,  9.8740e-03],
          [-2.7185e-01, -7.1709e-01,  3.1292e-01],
          [-7.5753e-02, -2.2079e-01,  3.3455e-01]],

         [[ 3.0924e-01,  6.7071e-01,  2.0546e-02],
          [-4.6607e-01, -1.0697e+00,  3.3501e-01],
          [-8.0284e-02, -3.0522e-01,  5.4460e-01]],

         [[ 3.1572e-01,  4.2335e-01, -3.4976e-01],
          [ 8.6354e-02, -4.6457e-01,  1.1803e-02],
          [ 1.0483e-01, -1.4584e-01, -1.5765e-02]]],


        ...,


        [[[ 7.7599e-02,  1.2692e-01,  3.2305e-02],
          [ 2.2131e-01,  2.4681e-01, -4.6637e-02],
          [ 4.6407e-02,  2.8246e-02,  1.7528e-02]],

         [[-1.8327e-01, -6.7425e-02, -7.2120e-03],
          [-4.8855e-02,  7.0427e-03, -1.2883e-01],
          [-6.4601e-02, -6.4566e-02,  4.4235e-02]],

         [[-2.2547e-01, -1.1931e-01, -2.3425e-02],
          [-9.9171e-02, -1.5143e-02,  9.5385e-04],
          [-2.6137e-02,  1.3567e-03,  1.4282e-01]]],


        [[[ 1.6520e-02, -3.2225e-02, -3.8450e-03],
          [-6.8206e-02, -1.9445e-01, -1.4166e-01],
          [-6.9528e-02, -1.8340e-01, -1.7422e-01]],

         [[ 4.2781e-02, -6.7529e-02, -7.0309e-03],
          [ 1.1765e-02, -1.4958e-01, -1.2361e-01],
          [ 1.0205e-02, -1.0393e-01, -1.1742e-01]],

         [[ 1.2661e-01,  8.5046e-02,  1.3066e-01],
          [ 1.7585e-01,  1.1288e-01,  1.1937e-01],
          [ 1.4656e-01,  9.8892e-02,  1.0348e-01]]],


        [[[ 3.2176e-02, -1.0766e-01, -2.6388e-01],
          [ 2.7957e-01, -3.7416e-02, -2.5471e-01],
          [ 3.4872e-01,  3.0041e-02, -5.5898e-02]],

         [[ 2.5063e-01,  1.5543e-01, -1.7432e-01],
          [ 3.9255e-01,  3.2306e-02, -3.5191e-01],
          [ 1.9299e-01, -1.9898e-01, -2.9713e-01]],

         [[ 4.6032e-01,  4.3399e-01,  2.8352e-01],
          [ 1.6341e-01, -5.8165e-02, -1.9196e-01],
          [-1.9521e-01, -4.5630e-01, -4.2732e-01]]]])), ('features.0.bias', tensor([ 0.4034,  0.3778,  0.4644, -0.3228,  0.3940, -0.3953,  0.3951, -0.5496,
         0.2693, -0.7602, -0.3508,  0.2334, -1.3239, -0.1694,  0.3938, -0.1026,
         0.0460, -0.6995,  0.1549,  0.5628,  0.3011,  0.3425,  0.1073,  0.4651,
         0.1295,  0.0788, -0.0492, -0.5638,  0.1465, -0.3890, -0.0715,  0.0649,
         0.2768,  0.3279,  0.5682, -1.2640, -0.8368, -0.9485,  0.1358,  0.2727,
         0.1841, -0.5325,  0.3507, -0.0827, -1.0248, -0.6912, -0.7711,  0.2612,
         0.4033, -0.4802, -0.3066,  0.5807, -1.3325,  0.4844, -0.8160,  0.2386,
         0.2300,  0.4979,  0.5553,  0.5230, -0.2182,  0.0117, -0.5516,  0.2108])), ('features.2.weight', tensor([[[[-3.0606e-02, -9.8520e-02, -1.3260e-01],
          [ 6.8208e-03, -8.3483e-02, -1.6697e-01],
          [ 3.1015e-02, -6.5803e-02, -1.3171e-01]],

         [[ 4.7407e-02, -2.7588e-02, -5.1127e-02],
          [ 7.0129e-02,  8.2528e-03, -1.8340e-02],
          [ 6.9918e-02,  3.8993e-02,  1.6228e-02]],

         [[ 7.0700e-02,  5.2703e-03, -4.7362e-02],
          [ 8.4006e-02,  4.9190e-02, -1.6474e-03],
          [ 8.5166e-03,  2.2350e-02,  5.9118e-03]],

         ...,

         [[ 2.7666e-02,  2.1778e-02, -9.4606e-03],
          [ 2.5511e-02,  4.1186e-03, -3.4521e-02],
          [ 2.0150e-02,  3.7068e-02, -1.3509e-02]],

         [[ 2.1684e-02,  4.1812e-02,  5.8284e-02],
          [ 2.7431e-02,  3.6847e-02,  3.4335e-02],
          [-9.4839e-03,  1.9745e-02,  5.0264e-02]],

         [[ 2.1769e-02, -2.1388e-02, -9.9363e-02],
          [-5.7156e-02, -7.1328e-02, -7.7600e-02],
          [-3.7508e-02, -2.5453e-02, -4.5096e-03]]],


        [[[-1.3319e-02, -7.7979e-02, -1.3496e-01],
          [-3.7411e-02, -8.1807e-02, -1.4195e-01],
          [-4.1913e-02, -1.0756e-01, -1.6164e-01]],

         [[-6.8725e-03,  4.8598e-02,  1.5008e-02],
          [ 1.8636e-02,  9.8393e-03, -1.5973e-02],
          [ 9.5164e-04, -3.2665e-02, -3.5824e-02]],

         [[ 1.4780e-02, -1.4260e-02, -4.4468e-02],
          [-1.8438e-02,  1.4841e-02, -8.2337e-02],
          [ 1.8329e-02,  2.1435e-03,  9.0911e-03]],

         ...,

         [[ 4.0342e-02,  3.6146e-02,  2.5515e-02],
          [ 1.5779e-02,  3.1012e-03, -1.0942e-02],
          [ 2.3790e-02,  1.6440e-02, -2.5835e-02]],

         [[-2.2844e-02,  2.5371e-03, -2.1714e-02],
          [ 3.9534e-04, -6.4903e-03,  1.6979e-02],
          [-4.7200e-03, -2.2301e-02, -2.1298e-02]],

         [[-2.8434e-02, -2.6771e-02,  2.7432e-02],
          [-5.8088e-02, -5.5869e-02,  7.0289e-02],
          [-6.4470e-02, -3.8172e-02,  4.1569e-02]]],


        [[[ 1.2508e-02,  2.4738e-02,  5.3893e-02],
          [-2.5838e-02, -1.6176e-02,  2.8344e-02],
          [ 1.2948e-02,  9.0717e-03,  2.8181e-02]],

         [[-7.9309e-02, -8.8828e-02, -5.5737e-02],
          [-4.8359e-02, -1.1139e-01, -1.0901e-02],
          [ 3.4640e-02,  2.3298e-02,  1.1002e-01]],

         [[-4.3616e-02, -1.6598e-02, -1.0547e-02],
          [ 2.8982e-02,  4.5279e-02,  1.6869e-02],
          [ 8.8168e-02,  1.2599e-01,  7.2292e-02]],

         ...,

         [[ 1.3967e-03,  1.5333e-02, -1.7196e-02],
          [-8.3107e-03, -1.2905e-02, -1.4394e-03],
          [ 6.3471e-03,  1.7825e-03, -3.3770e-02]],

         [[-7.9354e-03, -5.8610e-03, -7.6292e-05],
          [ 6.8661e-04, -6.0019e-03,  1.0119e-02],
          [ 3.0581e-02,  1.6821e-02,  3.2570e-02]],

         [[ 5.9351e-02, -7.4398e-03,  3.8274e-02],
          [-2.0792e-02, -4.8833e-02,  4.0274e-02],
          [ 2.3138e-02,  7.4794e-03,  3.5027e-02]]],


        ...,


        [[[-4.5464e-02, -2.9275e-02,  1.0282e-02],
          [-4.6952e-02, -4.9473e-02,  1.7632e-02],
          [-4.3815e-02, -2.4871e-02, -2.4908e-02]],

         [[-1.9359e-02,  1.5948e-02, -6.3554e-02],
          [ 3.0096e-02,  2.8515e-02, -6.4439e-02],
          [-1.4547e-02,  2.2238e-03, -6.3371e-02]],

         [[-2.7915e-02, -2.1738e-02, -5.1691e-02],
          [ 1.0889e-02, -5.1994e-02, -5.4649e-02],
          [-3.9741e-02,  5.2832e-04,  3.5375e-02]],

         ...,

         [[-1.9130e-03,  1.0995e-03, -7.4082e-03],
          [ 1.8428e-03,  8.2602e-03,  1.8680e-02],
          [ 1.1709e-02,  6.9263e-03,  3.3630e-02]],

         [[ 8.9195e-03,  3.2807e-02,  3.9282e-02],
          [-2.5044e-03,  1.7645e-03,  1.4056e-02],
          [-5.4708e-03,  9.5572e-03,  2.8639e-02]],

         [[-3.0241e-02, -6.7225e-02, -7.4299e-02],
          [-3.6222e-02, -9.7721e-03,  6.1669e-02],
          [-1.6392e-02,  5.8156e-02,  1.2894e-01]]],


        [[[ 4.0321e-02,  3.7677e-02,  1.7181e-02],
          [ 4.0298e-02,  2.9479e-02,  1.6698e-02],
          [-4.8739e-03,  2.1128e-02, -2.6295e-03]],

         [[ 3.1079e-02, -1.6475e-02,  1.0769e-02],
          [-5.8626e-02, -4.6721e-02, -2.7764e-02],
          [-3.1245e-02,  1.7635e-02, -1.2211e-02]],

         [[-9.8675e-02, -9.8915e-02, -1.3225e-01],
          [ 7.3214e-02, -7.5238e-03, -7.4033e-02],
          [ 1.7070e-01,  1.8346e-01,  3.3906e-02]],

         ...,

         [[ 2.5318e-02,  3.2680e-02,  5.2874e-03],
          [-4.1894e-03,  2.0011e-02,  1.6021e-02],
          [-4.8276e-03, -2.9130e-02,  7.4975e-04]],

         [[ 7.1959e-03, -5.1528e-03,  5.1333e-03],
          [-8.6466e-04,  1.2417e-02,  2.0805e-02],
          [ 2.4862e-03, -1.3194e-02,  3.6563e-03]],

         [[ 3.2415e-02,  1.0823e-02,  3.1720e-02],
          [-8.4911e-03,  5.9831e-02,  3.4606e-02],
          [-2.0674e-02,  1.6525e-02, -1.3183e-02]]],


        [[[-6.6955e-02,  1.0821e-02,  7.9260e-02],
          [ 1.0361e-02, -3.3380e-02,  5.2775e-02],
          [-3.8372e-02, -3.0964e-02,  6.5422e-02]],

         [[ 5.4925e-02, -1.9160e-01,  9.9709e-02],
          [-1.8754e-01,  1.3248e-02,  2.4748e-01],
          [-5.6662e-03,  2.8737e-02, -8.9787e-02]],

         [[-1.4905e-01, -1.2974e-01,  1.7649e-01],
          [-1.5774e-01,  1.5130e-01,  8.4126e-02],
          [ 9.4988e-02,  8.5186e-02, -3.3635e-02]],

         ...,

         [[ 1.2278e-02,  3.3348e-02, -1.0524e-02],
          [ 5.0310e-02, -9.1280e-03, -3.3890e-02],
          [ 1.3459e-02, -2.9601e-02,  2.6862e-02]],

         [[ 3.1006e-02,  2.8481e-02,  5.2361e-03],
          [ 3.8914e-03, -1.8899e-02, -2.1819e-02],
          [-8.4505e-03, -3.6632e-02, -1.9476e-02]],

         [[ 2.3835e-02,  4.5658e-02,  6.7297e-02],
          [ 1.1103e-02,  3.2035e-02, -5.8449e-02],
          [ 2.6805e-02, -9.3975e-02, -4.0504e-02]]]])), ('features.2.bias', tensor([ 0.0020, -0.0902,  0.6164, -0.0818,  0.2450, -0.0488,  0.1307, -0.0290,
        -0.1429,  0.3068, -0.0399, -0.2524,  0.0999, -0.2326,  0.0353, -0.0904,
         0.1138, -0.0307, -0.0108, -0.0215,  0.0554,  0.1382,  0.0362, -0.4511,
         0.0056, -0.0246, -0.4296, -0.1458,  0.3813, -0.0359,  0.1184, -0.3527,
        -0.0239, -0.0235,  0.6499, -0.0634, -0.0152, -0.2285,  0.0941, -0.5053,
         0.1906,  0.0944,  0.3406, -0.0833,  0.1924, -0.1953, -0.0421, -0.1606,
         0.3964,  0.2068,  0.1812, -0.1198, -0.0724, -0.1240,  0.1313,  0.1043,
         0.5469,  0.5208,  0.0509, -0.8278,  0.4372, -0.3734, -0.3264, -0.1213])), ('features.5.weight', tensor([[[[-6.2810e-02,  1.1339e-02, -4.0391e-02],
          [-5.1637e-02, -5.7086e-02, -1.2647e-01],
          [-1.3824e-02, -5.4079e-02, -8.2741e-02]],

         [[-5.1361e-02, -3.3589e-02, -3.0128e-02],
          [-3.1981e-02, -3.5140e-02,  2.4252e-03],
          [-4.1960e-03, -1.4064e-02,  1.3642e-02]],

         [[-2.8838e-02,  5.2136e-02,  5.1848e-02],
          [-3.7392e-02,  1.4356e-01, -3.5255e-02],
          [-2.9268e-02,  2.1488e-02, -3.1739e-02]],

         ...,

         [[-2.3000e-02, -1.1137e-02, -4.2528e-03],
          [-1.9321e-02, -4.3134e-02, -5.5873e-04],
          [-4.2867e-02, -1.4233e-02, -1.3526e-02]],

         [[-2.7698e-02, -1.6312e-02, -2.3137e-02],
          [ 2.7924e-02,  3.4780e-02, -4.5055e-02],
          [ 4.9343e-02,  1.1931e-02, -3.7526e-03]],

         [[ 1.4084e-02,  1.7446e-02, -8.3521e-03],
          [ 6.4733e-03,  7.4886e-02, -5.2302e-03],
          [-3.3729e-02,  5.7670e-02, -1.1322e-02]]],


        [[[-8.6400e-04, -3.0072e-02, -2.5162e-02],
          [-1.5606e-02, -3.7128e-02, -4.2133e-02],
          [-4.9897e-03, -2.8128e-03, -4.8388e-02]],

         [[-2.1050e-02, -1.2844e-02,  2.3434e-03],
          [-3.1928e-02, -3.5125e-02,  1.3496e-02],
          [ 1.2840e-02, -2.1722e-03,  1.9916e-02]],

         [[-5.4853e-02, -1.4703e-02,  5.7742e-02],
          [-1.4970e-01,  9.0838e-02,  1.8018e-01],
          [-5.1293e-02,  4.0009e-03,  7.5791e-02]],

         ...,

         [[ 1.3281e-02, -2.7738e-02, -4.9568e-02],
          [ 2.3973e-02, -2.3895e-02, -6.5836e-03],
          [ 5.9873e-02,  2.1132e-02, -1.5224e-02]],

         [[-5.2145e-02, -2.6414e-02, -2.5841e-02],
          [-3.0816e-02, -5.0158e-02,  3.9022e-02],
          [ 4.1870e-02, -2.2169e-02, -3.2523e-02]],

         [[-2.4134e-03,  3.2657e-03,  2.7356e-02],
          [-4.2036e-02,  7.5291e-03, -1.1726e-02],
          [ 4.0441e-02,  1.2264e-01, -4.8728e-02]]],


        [[[ 3.3180e-02, -2.2260e-02, -3.3540e-03],
          [ 1.4570e-02,  7.5933e-02, -5.2729e-02],
          [-4.9156e-02,  3.9846e-02,  8.7439e-04]],

         [[ 1.5670e-02,  5.4018e-03,  4.5666e-02],
          [-6.3589e-03,  4.6707e-02,  4.5305e-02],
          [-7.1617e-02,  3.8063e-02,  1.4691e-02]],

         [[-4.5694e-02,  3.2703e-02,  1.1262e-02],
          [-4.9579e-02,  2.9527e-02, -2.7634e-02],
          [ 1.1622e-02,  5.6397e-02, -2.6861e-02]],

         ...,

         [[ 1.1792e-02, -2.6591e-02, -2.0085e-04],
          [-6.0890e-02, -5.5885e-02, -3.8149e-02],
          [ 3.8406e-02, -9.7790e-03, -1.4222e-03]],

         [[-4.4498e-02, -2.2446e-02, -6.2459e-02],
          [-2.5728e-02,  1.1222e-02, -2.5034e-02],
          [ 1.9746e-02, -4.1720e-02, -3.2745e-02]],

         [[ 2.3275e-02, -5.6597e-04,  1.7023e-02],
          [-3.7929e-02,  8.4074e-02,  1.5500e-02],
          [ 8.4187e-03, -5.3071e-02, -1.9120e-02]]],


        ...,


        [[[ 6.8440e-03, -9.4784e-03, -1.9466e-02],
          [-1.7608e-02,  4.3330e-02, -4.1369e-02],
          [-2.6391e-02, -2.8507e-02, -9.8986e-04]],

         [[-6.2622e-02, -4.5775e-02,  1.0037e-02],
          [-3.5123e-02, -5.3560e-02,  2.6610e-02],
          [ 7.1417e-03, -1.4646e-02,  6.5733e-03]],

         [[ 1.5414e-02,  2.7492e-01,  2.1435e-01],
          [-9.2970e-02, -1.7520e-02,  6.8770e-02],
          [-1.4798e-01, -1.1129e-01, -7.8531e-02]],

         ...,

         [[-8.9160e-03,  5.5912e-02,  8.1550e-03],
          [-8.3287e-03, -3.8522e-02, -4.4384e-02],
          [ 3.0769e-02,  5.2761e-02, -3.3069e-03]],

         [[ 4.4858e-03,  1.0840e-01, -9.7890e-03],
          [-3.9745e-02, -1.3879e-01,  1.2488e-02],
          [-4.7321e-02, -2.9251e-02, -2.4057e-02]],

         [[-9.8491e-02,  7.1428e-03, -3.5822e-02],
          [-3.7229e-02,  1.6014e-01, -2.8598e-02],
          [-1.4895e-02,  7.6893e-02,  7.7165e-02]]],


        [[[ 7.3394e-02,  4.9751e-02,  2.0830e-02],
          [ 1.6439e-02,  1.7401e-02, -2.3603e-02],
          [-2.3165e-02, -9.2761e-02, -2.4903e-02]],

         [[-4.5251e-02, -2.4458e-02,  9.8124e-03],
          [-8.4512e-03, -2.0820e-02,  2.8578e-02],
          [ 4.5104e-02,  1.2810e-03,  2.3833e-02]],

         [[ 8.3300e-02,  6.6573e-02,  3.1433e-02],
          [-1.1266e-01,  9.9167e-02,  1.6835e-01],
          [-3.5607e-02, -4.2154e-02,  5.0973e-02]],

         ...,

         [[-6.1448e-02,  3.5827e-02,  5.3240e-02],
          [-4.3761e-02, -2.4301e-02,  2.9110e-02],
          [-3.8008e-04,  3.3345e-02,  5.7502e-03]],

         [[ 2.8796e-04,  6.5530e-03, -6.0024e-02],
          [-4.6629e-02, -1.9900e-02,  9.3691e-03],
          [ 7.9185e-02,  6.4821e-02,  1.0142e-02]],

         [[ 7.4917e-02,  4.8451e-02,  1.5926e-01],
          [-4.0570e-02, -1.6576e-01,  3.1683e-02],
          [-5.5403e-02, -1.4255e-02,  2.3551e-02]]],


        [[[-1.4041e-02, -9.3939e-03,  3.3714e-02],
          [ 6.1786e-02, -7.3343e-02, -4.9163e-02],
          [ 7.0314e-02,  7.0862e-02, -3.5670e-02]],

         [[-6.0474e-03,  2.3996e-03,  2.4723e-02],
          [ 1.1873e-02, -1.4914e-02,  2.6962e-02],
          [-9.5375e-03, -2.8718e-02, -1.2086e-02]],

         [[-1.0172e-01, -2.3414e-01, -5.6336e-02],
          [ 7.5019e-02,  1.3930e-03, -6.2536e-02],
          [ 1.4913e-01,  2.4970e-01,  1.4187e-01]],

         ...,

         [[-6.7739e-03, -4.8837e-02, -3.6353e-03],
          [ 1.8116e-02, -3.6125e-02,  6.8408e-03],
          [ 3.9892e-02,  4.8252e-04,  1.6367e-02]],

         [[-6.7317e-02, -1.9475e-01, -9.3308e-02],
          [ 1.3558e-01,  7.9305e-02, -9.1780e-02],
          [ 1.0593e-02,  3.3229e-02,  2.0905e-02]],

         [[ 7.5557e-02, -2.7272e-02,  1.5518e-02],
          [-6.9644e-03, -1.0359e-01,  4.6841e-02],
          [ 3.0022e-02, -5.4782e-02,  5.3461e-02]]]])), ('features.5.bias', tensor([ 8.6646e-02, -1.8141e-02,  1.3419e-01,  2.1687e-02,  6.2591e-02,
        -7.4722e-02,  3.3089e-02,  9.0404e-02,  1.8341e-01,  7.4501e-02,
         5.9911e-02, -1.4331e-02,  1.7103e-01,  6.2786e-03,  3.5013e-02,
         1.7912e-01, -5.8908e-02,  1.2702e-01,  1.7914e-01,  2.3746e-01,
         1.8726e-02, -2.8949e-02,  1.8745e-01,  3.9840e-02,  1.4654e-01,
         2.1923e-02,  1.0498e-01,  1.4209e-01, -7.0994e-02, -1.8345e-02,
         8.8975e-02,  5.7054e-02,  1.3888e-01,  2.0818e-01,  1.0774e-01,
         8.5410e-02,  1.7150e-02,  2.7108e-01,  8.7119e-02,  5.9371e-02,
         3.1665e-01, -5.2632e-02,  1.5077e-01,  6.4080e-02,  1.7603e-01,
         1.7029e-01, -6.4618e-02,  1.3616e-01,  1.6723e-02, -6.7827e-02,
         6.3060e-02,  1.4921e-01,  1.0507e-01,  4.7822e-02,  2.7649e-01,
         7.2342e-02, -1.2613e-01,  1.6345e-01, -6.4522e-02, -7.8599e-03,
         1.4376e-01,  1.6144e-01,  2.5510e-02,  1.1751e-01, -8.8816e-02,
         2.2240e-01,  5.5771e-02,  1.4372e-02,  1.6451e-01, -1.9882e-01,
         1.9057e-04,  2.2923e-02, -1.7259e-01,  8.1201e-02,  3.7978e-02,
        -1.1063e-01,  6.8450e-02,  5.3313e-02,  5.5594e-03,  6.8257e-02,
        -2.5634e-01,  8.1244e-02, -6.9248e-02,  5.4548e-02, -5.9897e-02,
         1.2019e-01, -1.7203e-01,  7.0961e-02,  3.0969e-02, -8.0818e-02,
         5.1265e-02, -2.0620e-01,  1.9448e-01, -8.8990e-02, -8.6148e-02,
         1.7088e-01,  1.6314e-01,  2.2548e-01,  1.3626e-01, -2.8991e-02,
        -8.5338e-02, -1.5907e-03,  1.2849e-02, -7.6387e-02, -2.3490e-02,
         3.2957e-02,  1.6553e-01, -2.1522e-02, -1.0091e-02,  1.2563e-01,
         2.0017e-01,  1.6585e-01,  2.4983e-02,  9.0528e-02,  1.5877e-01,
        -1.4161e-01,  8.8158e-02,  4.9040e-02, -7.7915e-02,  1.3045e-01,
         8.2526e-02,  2.0595e-01,  7.4943e-02, -9.7283e-03, -1.0830e-02,
         7.4388e-02,  7.4235e-02,  1.4483e-01])), ('features.7.weight', tensor([[[[ 2.5788e-02, -1.9852e-02, -1.0697e-02],
          [-1.6114e-02, -4.1759e-03,  8.4582e-03],
          [ 4.0309e-03,  1.8973e-02,  3.8059e-02]],

         [[-5.4261e-02, -2.9872e-02,  1.1506e-02],
          [-1.8266e-02, -1.5708e-02, -1.2726e-02],
          [ 2.0867e-02, -5.6425e-03, -5.1218e-04]],

         [[ 1.8961e-02, -2.3766e-03,  6.1427e-03],
          [-5.1761e-02, -1.7272e-02,  8.7075e-03],
          [-4.4383e-02,  2.3661e-02,  9.0710e-02]],

         ...,

         [[-1.8603e-02, -2.2412e-02,  1.4266e-03],
          [-1.0810e-02, -1.2563e-02,  5.8555e-02],
          [-1.9603e-02,  3.8292e-02,  6.6033e-02]],

         [[ 8.0053e-02,  4.5974e-02,  4.2854e-02],
          [ 3.4144e-02,  4.1228e-02,  8.4107e-03],
          [-8.5212e-02, -7.2149e-02, -6.1367e-02]],

         [[-5.1872e-02, -1.7269e-02,  8.3412e-03],
          [-1.5657e-02,  6.5357e-03,  5.3442e-03],
          [ 7.0546e-02,  6.6640e-02,  2.9743e-02]]],


        [[[ 1.4477e-02,  1.7372e-02,  3.8637e-02],
          [ 1.7122e-02,  6.5499e-03,  3.3277e-02],
          [ 5.1735e-02,  5.2232e-02,  2.2086e-02]],

         [[-4.9817e-03,  7.8477e-03,  1.0481e-03],
          [-5.5254e-03,  1.1731e-03, -2.8846e-02],
          [-1.5166e-02,  1.4712e-02, -2.5996e-02]],

         [[ 1.4313e-02,  7.7863e-03, -2.5710e-02],
          [ 3.6445e-02,  3.8037e-02,  2.1568e-02],
          [ 3.9633e-02,  4.1395e-02, -2.7349e-02]],

         ...,

         [[ 1.9668e-02, -1.8495e-02, -4.5170e-03],
          [ 1.0013e-02,  8.0232e-03, -4.4554e-02],
          [ 2.3961e-02, -2.2513e-02,  3.8967e-03]],

         [[-9.3318e-03, -2.7975e-03, -4.5400e-03],
          [ 1.9306e-03, -3.1315e-02,  6.2495e-03],
          [ 8.4360e-03, -3.6533e-02,  3.6175e-03]],

         [[-3.0665e-02, -4.4897e-02, -7.7372e-02],
          [-3.9120e-02, -6.0861e-02, -8.4005e-02],
          [ 5.7575e-02, -4.9973e-04, -1.2297e-01]]],


        [[[-3.7533e-02,  6.1958e-02, -1.5773e-02],
          [-4.7994e-02, -5.2918e-02, -5.5357e-02],
          [-9.8468e-04, -2.2081e-02,  8.1542e-03]],

         [[ 2.1069e-02, -3.1143e-02, -2.8263e-02],
          [-5.5108e-02, -1.2559e-01, -8.1983e-02],
          [ 2.1143e-02, -3.4396e-02, -1.1907e-02]],

         [[-9.8582e-03, -5.1275e-03,  1.4424e-03],
          [ 5.5997e-02,  1.3562e-01,  1.9257e-02],
          [-6.5687e-02, -1.8309e-02, -3.9470e-02]],

         ...,

         [[ 2.8227e-02,  4.5086e-02, -3.0288e-02],
          [-1.6840e-02, -2.2179e-03, -3.2186e-02],
          [-4.6969e-02, -8.1806e-02,  7.7194e-02]],

         [[-7.4163e-02, -4.7645e-02,  5.8225e-02],
          [-7.1075e-02,  1.0040e-02,  6.5806e-02],
          [-3.9398e-03, -9.7729e-03,  9.5199e-02]],

         [[-4.3413e-02,  2.7101e-02, -1.2636e-02],
          [ 3.7488e-03,  4.2913e-03,  3.0900e-03],
          [ 3.3433e-02,  3.0384e-02,  5.1019e-02]]],


        ...,


        [[[ 1.5468e-02,  5.1462e-02,  2.2881e-02],
          [ 5.7329e-02,  1.7325e-02, -1.2769e-02],
          [ 3.1118e-02, -3.9026e-02, -6.2358e-02]],

         [[-7.0737e-02, -4.5867e-02, -1.8765e-02],
          [-6.7420e-03, -1.0010e-02, -6.2032e-02],
          [ 6.2941e-03, -1.3777e-02, -5.5997e-02]],

         [[-1.2475e-02,  2.6069e-02, -4.5512e-03],
          [ 4.8936e-02, -7.6861e-03, -1.0415e-01],
          [ 1.1287e-02, -4.4848e-02, -8.4382e-03]],

         ...,

         [[ 7.0006e-02,  5.7238e-02, -3.4275e-03],
          [ 4.7454e-02,  4.8209e-03, -8.8796e-02],
          [ 6.8828e-02, -3.6591e-02, -8.3883e-02]],

         [[-8.6139e-02, -4.4840e-02, -5.2773e-02],
          [-3.1619e-02,  8.5002e-04,  2.5091e-02],
          [ 4.1867e-03,  2.5540e-02,  5.2885e-02]],

         [[-2.6334e-02, -8.2095e-02, -4.9413e-02],
          [-1.4520e-02, -6.7272e-02, -4.8400e-02],
          [-3.4450e-02, -5.3121e-02,  1.4509e-02]]],


        [[[-2.1221e-02, -2.6395e-02, -6.8177e-02],
          [-1.3308e-02, -2.4194e-02, -2.1912e-02],
          [-1.8293e-02, -1.8923e-02, -1.0353e-02]],

         [[-2.7944e-02, -2.5907e-02, -1.5582e-02],
          [-4.8443e-02, -6.0070e-03,  1.2176e-04],
          [-3.3587e-02, -2.2929e-02, -3.5778e-03]],

         [[-5.3952e-02, -5.4047e-02, -2.1393e-02],
          [-2.5399e-02, -4.8201e-03,  1.2715e-02],
          [-3.3006e-02, -9.2941e-03,  4.0095e-03]],

         ...,

         [[ 1.0834e-01,  3.6012e-02, -1.4283e-02],
          [ 6.2926e-02,  9.6225e-03, -1.5355e-02],
          [ 3.4179e-02, -2.8131e-03, -3.6031e-02]],

         [[-6.5453e-02, -4.3534e-02, -1.2491e-02],
          [-6.4196e-02, -5.0347e-02, -1.9350e-02],
          [-2.0023e-02,  6.0370e-04,  1.2963e-03]],

         [[-1.2661e-02, -8.3580e-03,  5.1847e-03],
          [ 4.2209e-03, -1.9068e-02,  1.4444e-02],
          [ 4.2795e-03,  7.2975e-03,  1.5227e-02]]],


        [[[-7.0003e-03,  1.0324e-02, -7.5080e-03],
          [-4.3927e-04,  4.9710e-03,  2.4126e-02],
          [ 4.4565e-03,  3.8436e-02,  6.3350e-03]],

         [[-1.2821e-02,  1.2153e-02,  1.8981e-02],
          [-9.3514e-03,  1.8435e-02, -1.3223e-02],
          [-5.3401e-04,  1.0125e-02, -6.2764e-03]],

         [[-3.9147e-05,  2.6507e-02, -2.3274e-02],
          [-3.3350e-02,  3.1395e-02, -3.3022e-02],
          [-2.0826e-02,  2.2062e-03, -4.0605e-02]],

         ...,

         [[-1.3357e-02,  1.3738e-02, -3.0007e-02],
          [-4.8696e-03,  3.5501e-02, -3.0733e-02],
          [-3.6084e-02, -4.8515e-03, -2.5580e-02]],

         [[ 4.5643e-02, -8.4773e-03, -1.2161e-02],
          [ 2.9042e-02,  1.0096e-02,  2.8676e-02],
          [-1.9727e-02, -2.3097e-02,  1.5411e-03]],

         [[ 4.5912e-02,  5.1751e-02, -1.0848e-02],
          [-6.4884e-03, -2.1099e-02, -1.6500e-02],
          [-7.0777e-03, -5.5341e-03,  1.7106e-02]]]])), ('features.7.bias', tensor([-2.6160e-02,  3.7561e-01, -1.0959e-01, -1.2908e-01, -3.3063e-02,
        -1.7771e-01,  2.6658e-01, -3.4235e-04,  1.0146e-01, -1.3632e-01,
        -1.3493e-01, -8.2296e-02, -3.8719e-02, -1.3540e-02,  1.4804e-01,
         1.4590e-01,  1.2211e-01, -2.6188e-01, -3.8504e-03,  2.6068e-01,
        -1.3415e-01,  8.1108e-02,  4.6663e-02,  8.8426e-02,  9.2182e-01,
         1.7636e-01,  2.6631e-01, -2.4935e-02,  1.4909e-01,  5.3638e-02,
         6.0319e-02,  1.1674e-01, -1.2548e-01,  1.7780e-01, -3.8083e-02,
        -7.0598e-02, -1.6346e-02, -8.9410e-03, -2.6236e-01,  1.8348e-01,
        -2.4746e-02, -1.6002e-02,  4.1249e-02, -1.3394e-01,  4.4561e-02,
        -2.6911e-01, -5.6208e-02,  3.5030e-02, -4.0998e-02, -8.0173e-03,
        -9.4496e-02,  1.1803e-01, -2.1164e-01,  2.5524e-01,  8.3103e-02,
        -8.4798e-02,  1.7564e-04,  3.2745e-02,  1.9275e-02, -8.3005e-02,
         1.2351e-01,  1.2453e-01,  4.2522e-02,  1.9826e-01,  3.5919e-02,
         3.3214e-02, -1.5068e-02,  1.7456e-02, -5.5684e-02,  1.8592e-02,
         9.8663e-02,  5.8580e-03, -7.4203e-02,  8.3461e-02,  1.1803e-01,
         2.2759e-01,  2.6386e-01,  1.8882e-02,  7.1198e-03,  2.4375e-02,
        -3.8069e-02,  1.1858e-01, -2.5809e-02, -1.6493e-01, -6.0023e-02,
         1.5828e-01, -1.8128e-02,  1.7147e-02, -7.6780e-02, -1.1399e-01,
        -1.0978e-02,  1.5395e-02, -1.7809e-01,  2.4206e-02, -6.1828e-02,
         5.8281e-02, -2.2583e-02, -4.3978e-03, -2.1522e-01,  3.5710e-01,
         7.0420e-02,  8.9824e-02, -1.2217e-01,  2.8388e-02,  2.8128e-01,
         3.2103e-02, -2.4124e-02,  9.8025e-02,  1.9275e-01,  4.8849e-02,
         1.8694e-01, -3.0950e-01,  4.4180e-02,  2.6609e-01, -6.0079e-02,
        -1.0044e-01, -2.3358e-01,  6.0253e-02, -5.7333e-02,  4.0281e-02,
        -1.8849e-01, -1.0592e-01,  2.7282e-01,  1.7372e-01,  2.6091e-01,
        -3.5119e-02,  6.3524e-02,  2.1413e-01])), ('features.10.weight', tensor([[[[-1.1008e-02,  5.2181e-04,  2.0165e-02],
          [-1.9239e-02, -3.1387e-02, -9.3394e-03],
          [-5.2665e-02, -5.4552e-02, -6.9972e-03]],

         [[ 2.0017e-02,  1.7184e-02,  2.1192e-02],
          [ 8.5676e-03,  1.1236e-02,  2.0709e-02],
          [ 6.6602e-03, -2.2648e-02,  1.2209e-02]],

         [[ 4.9262e-02,  1.0558e-02, -2.9823e-03],
          [-8.8304e-04,  1.2206e-02,  2.0749e-03],
          [ 2.7586e-02,  7.7105e-05,  2.1245e-02]],

         ...,

         [[-2.0546e-02,  2.1967e-02,  2.3511e-02],
          [-6.7902e-02, -8.1078e-03,  2.6165e-02],
          [-1.0581e-01, -6.6538e-02,  2.7534e-03]],

         [[ 3.6559e-02,  3.6259e-02,  4.6347e-02],
          [-9.3869e-03,  7.9205e-03,  3.2348e-02],
          [-3.5539e-02, -1.5318e-02,  1.1864e-03]],

         [[-2.1000e-02,  5.7321e-03, -8.2030e-03],
          [-1.8231e-02,  1.2254e-02,  1.4853e-02],
          [-3.0732e-02, -5.5477e-03, -2.5914e-03]]],


        [[[-1.1417e-02, -2.8491e-02, -3.2380e-02],
          [ 2.3106e-03, -1.5136e-02, -2.7720e-02],
          [-4.1440e-02, -3.7288e-02, -1.8089e-02]],

         [[ 3.9357e-03, -6.3219e-03,  6.6615e-03],
          [ 2.0829e-02,  1.1740e-02, -2.5786e-03],
          [ 2.2405e-02,  1.2657e-02, -1.9856e-02]],

         [[ 5.5530e-02,  7.8947e-02,  7.7657e-02],
          [ 9.1851e-02,  3.1986e-01,  1.6033e-01],
          [ 7.9647e-02,  2.1483e-01,  1.2694e-01]],

         ...,

         [[ 1.3931e-03, -3.2048e-02, -2.0430e-02],
          [-2.4674e-02, -4.8157e-02, -5.4472e-02],
          [-3.8650e-02, -5.1003e-02, -2.0275e-02]],

         [[ 4.0564e-02,  1.2618e-02,  9.2595e-03],
          [ 2.6360e-02, -1.4243e-02, -1.0471e-02],
          [-7.4169e-03, -2.0603e-02, -2.5345e-02]],

         [[ 1.3168e-04,  5.7046e-03, -2.1024e-04],
          [ 4.6556e-02,  7.7847e-03,  1.2681e-02],
          [ 6.8144e-04, -1.5033e-02, -1.1644e-02]]],


        [[[-2.0750e-02, -3.4188e-02, -2.8340e-03],
          [-4.3754e-02, -5.6995e-02,  1.2863e-02],
          [-3.1518e-02, -6.6091e-02,  1.4699e-02]],

         [[ 5.0747e-02, -3.6635e-03,  3.6801e-03],
          [-1.9261e-03, -4.4846e-02,  5.4276e-02],
          [-2.3349e-03, -2.0560e-02,  4.7001e-02]],

         [[ 2.7941e-02,  5.9823e-02, -1.0393e-02],
          [ 8.7131e-02, -4.7270e-03,  1.1249e-02],
          [ 6.9137e-02,  7.5738e-04,  1.6339e-02]],

         ...,

         [[-2.6982e-02,  4.0079e-02, -7.7930e-03],
          [-3.7076e-02, -1.9312e-02, -2.7063e-02],
          [-1.0673e-02, -2.4535e-02,  9.9783e-03]],

         [[-1.2083e-02,  2.4626e-03, -1.4940e-02],
          [ 2.1548e-03,  2.9447e-02, -2.1811e-03],
          [-2.0534e-02,  3.7243e-02, -2.7121e-02]],

         [[-1.3047e-02, -3.7589e-02, -6.5744e-02],
          [ 8.3570e-03,  8.3306e-03, -3.1694e-02],
          [-1.6594e-02, -2.7705e-03, -8.8299e-03]]],


        ...,


        [[[ 1.9315e-02,  1.2145e-02, -3.1176e-02],
          [ 6.3027e-03, -7.1481e-04, -3.1927e-02],
          [ 1.9364e-02,  4.2052e-03, -1.9566e-02]],

         [[-1.9855e-02,  1.7430e-02,  2.4015e-02],
          [ 2.1444e-02,  3.7237e-02,  1.4681e-02],
          [ 1.5801e-02,  2.6180e-02, -1.6995e-02]],

         [[ 4.5251e-02,  4.0553e-02, -7.1369e-03],
          [ 3.3669e-02,  2.8528e-02,  2.5468e-02],
          [ 8.5669e-04, -2.9174e-02, -1.8554e-02]],

         ...,

         [[-2.4969e-02, -3.0427e-02, -9.2000e-03],
          [ 1.9208e-02, -4.9419e-02, -3.1581e-02],
          [ 3.0536e-02, -2.1661e-02, -2.9521e-02]],

         [[ 4.3994e-02,  5.1959e-02,  3.9573e-02],
          [ 1.3979e-02,  1.1414e-02,  3.1020e-03],
          [ 3.2651e-04, -8.9496e-03, -7.7691e-03]],

         [[ 1.4944e-02,  5.2261e-03, -1.3485e-02],
          [ 3.2752e-02,  3.7579e-02,  2.5116e-02],
          [ 2.9907e-02,  5.7022e-02,  3.0312e-02]]],


        [[[ 4.9953e-02,  4.8833e-02,  5.2309e-02],
          [ 3.7285e-02,  1.9263e-02, -2.6015e-03],
          [ 2.8197e-02, -1.7366e-02, -1.4688e-02]],

         [[ 4.1824e-02,  5.1154e-02, -8.5273e-03],
          [ 3.7180e-02,  3.8831e-02,  3.7352e-03],
          [ 7.8400e-03,  2.2572e-02, -2.8450e-02]],

         [[-1.7513e-02,  1.5097e-02,  6.8811e-03],
          [-1.1041e-02, -4.0475e-02, -1.7788e-02],
          [-2.0693e-02, -5.6653e-03,  1.1377e-02]],

         ...,

         [[ 1.3747e-02,  9.7299e-03,  1.4505e-02],
          [ 2.7115e-02,  2.3613e-02,  4.5637e-02],
          [ 2.6436e-02,  5.4756e-02,  1.0891e-02]],

         [[ 2.0090e-02,  1.5176e-02,  1.1319e-02],
          [ 8.3680e-03, -1.9435e-02, -1.6546e-02],
          [ 6.3271e-04, -2.2041e-02,  4.5867e-04]],

         [[-5.0706e-03,  1.8152e-02, -9.4108e-03],
          [ 4.8371e-02,  4.0391e-02,  2.3098e-02],
          [-3.6311e-03, -1.9629e-02, -1.4882e-02]]],


        [[[-3.8183e-03, -3.6297e-02, -3.2657e-02],
          [-2.4205e-02, -9.7398e-03,  3.2626e-02],
          [-5.6366e-03, -4.0292e-03,  2.0640e-03]],

         [[ 3.1122e-02,  4.8816e-03, -1.5482e-02],
          [ 6.2455e-02,  5.1292e-02, -1.9035e-02],
          [ 5.9365e-03,  3.6890e-02, -1.8871e-02]],

         [[-2.6442e-02, -3.0729e-02, -4.8413e-02],
          [ 1.6397e-02, -6.3393e-03, -9.1918e-03],
          [ 2.1574e-03, -5.1694e-02, -2.1939e-02]],

         ...,

         [[ 1.9026e-03, -3.0305e-02, -1.5312e-02],
          [-1.8327e-02,  1.9854e-03,  1.4306e-03],
          [-3.1173e-02,  2.7919e-02,  3.5750e-02]],

         [[ 2.5499e-02, -1.9174e-04,  1.8887e-03],
          [ 2.0551e-02,  4.8186e-03, -2.3756e-02],
          [ 1.6665e-03,  1.3548e-02, -7.0371e-03]],

         [[-7.9219e-03, -9.3038e-03, -4.3883e-03],
          [ 2.5065e-02,  4.2599e-02,  5.9507e-02],
          [-3.5919e-02, -3.5388e-02, -1.7800e-02]]]])), ('features.10.bias', tensor([ 0.0202,  0.0338, -0.0698,  0.0923, -0.0507, -0.1150,  0.0449,  0.0521,
        -0.0903,  0.0583, -0.0690,  0.1236,  0.0341,  0.3370,  0.0851,  0.2053,
        -0.0117,  0.0298,  0.0317,  0.0693,  0.2639,  0.0290, -0.0116,  0.2532,
        -0.0276, -0.0319,  0.1731,  0.1032, -0.0482, -0.0700,  0.1377,  0.1121,
         0.1247, -0.1866,  0.0523,  0.0129, -0.0979,  0.0436, -0.0428, -0.0525,
        -0.0452,  0.0206, -0.0350, -0.2777,  0.0497, -0.0120,  0.0802,  0.0229,
        -0.0659, -0.0475,  0.0331,  0.0134,  0.0792, -0.1670, -0.0224,  0.2618,
        -0.0800, -0.0817,  0.1192,  0.1644,  0.0690, -0.0693, -0.0453,  0.0007,
         0.0384,  0.1381, -0.0329,  0.1217, -0.1571,  0.1048,  0.2537,  0.0729,
         0.0065, -0.1082,  0.0637,  0.1831,  0.0179,  0.0243, -0.0031,  0.0226,
         0.0155,  0.1098, -0.0128,  0.0941, -0.0131, -0.0109,  0.1651,  0.0746,
        -0.0199,  0.1716,  0.1827,  0.0386, -0.0462,  0.0753, -0.0519,  0.0758,
        -0.0737,  0.1672, -0.0833,  0.0866,  0.0048,  0.1771,  0.0611,  0.0143,
        -0.0191, -0.0037, -0.0503,  0.0224,  0.0290, -0.0603,  0.0606,  0.0479,
         0.0623,  0.0467,  0.0509,  0.0057, -0.1018,  0.3235,  0.0255, -0.0259,
         0.0334,  0.0222,  0.0960, -0.0305,  0.1143,  0.0661, -0.0127, -0.1167,
        -0.1040, -0.0135, -0.0364, -0.0290, -0.0250,  0.1876, -0.0326,  0.0989,
         0.0342, -0.0897,  0.0944,  0.1789, -0.0282,  0.1338,  0.0010, -0.1821,
        -0.0319, -0.0067, -0.0338,  0.0077, -0.0149,  0.0979,  0.1016,  0.2405,
         0.0388,  0.0089, -0.0198,  0.0120,  0.1005, -0.0686, -0.1431, -0.0015,
         0.0348,  0.0225, -0.0254, -0.0148, -0.1054,  0.0236, -0.0599,  0.0279,
        -0.0951, -0.0027, -0.0068,  0.0917,  0.0216,  0.0261,  0.1450, -0.0396,
        -0.0315, -0.1445,  0.0360,  0.0219,  0.1183,  0.0352, -0.0246,  0.0475,
         0.1258, -0.1394,  0.0567,  0.0946,  0.0147,  0.1129,  0.0779,  0.0804,
         0.0271, -0.0323, -0.0129, -0.0387, -0.0446,  0.1217,  0.0598,  0.0433,
        -0.1319,  0.1268, -0.1234,  0.0316, -0.0856,  0.1249,  0.0661,  0.0018,
        -0.0216, -0.0617,  0.2800, -0.0765,  0.1273, -0.0189,  0.0966, -0.1477,
        -0.0838,  0.1879,  0.0175,  0.0795, -0.1509,  0.0410, -0.0384,  0.1817,
        -0.0146, -0.0034, -0.1029,  0.0061, -0.0540,  0.0698, -0.0075,  0.0486,
         0.0549,  0.1806,  0.0658,  0.0229,  0.0516, -0.0191, -0.0434,  0.0674,
        -0.0060, -0.0954, -0.0659,  0.1381, -0.0737, -0.0144, -0.0212, -0.1298,
        -0.0794,  0.1023, -0.0754, -0.1380, -0.0433,  0.0886,  0.1197,  0.1059])), ('features.12.weight', tensor([[[[ 1.4458e-02,  5.4262e-02,  2.5967e-02],
          [-1.6342e-02,  1.6133e-02,  3.6962e-03],
          [-8.6773e-02, -4.2430e-02, -2.7797e-02]],

         [[ 8.4293e-03, -1.0796e-03,  5.8639e-03],
          [ 5.3881e-03, -3.8932e-03,  2.0397e-02],
          [-2.7216e-02, -1.7411e-03, -2.5664e-03]],

         [[-6.0055e-02,  2.7928e-02,  5.7307e-02],
          [-7.8412e-02,  1.0588e-03, -2.2218e-02],
          [-2.0841e-02,  5.3504e-02,  9.2433e-03]],

         ...,

         [[ 5.4644e-03,  9.6476e-03,  1.4500e-02],
          [ 7.9505e-04,  7.9915e-03,  5.1864e-03],
          [-9.7005e-03, -1.4069e-02, -8.9335e-03]],

         [[ 1.5228e-02, -3.4120e-02, -5.4391e-02],
          [-8.1824e-03, -7.1585e-03, -3.7906e-02],
          [-1.5072e-02,  6.2816e-02, -4.9534e-03]],

         [[ 1.1094e-02,  7.8073e-02,  2.7350e-02],
          [-2.2723e-02,  4.1529e-02, -1.9598e-02],
          [-1.6419e-02, -1.6679e-02, -9.1728e-03]]],


        [[[ 3.5749e-02,  2.4898e-02,  1.9001e-02],
          [ 8.7312e-04,  1.9976e-02,  2.9733e-02],
          [ 3.0736e-03,  4.2173e-03,  7.2681e-03]],

         [[ 4.7883e-02,  6.1909e-02,  9.2755e-02],
          [-9.3805e-03, -1.6869e-02,  2.8851e-02],
          [ 9.3722e-03, -3.0548e-02, -1.6118e-02]],

         [[ 1.1930e-02, -7.6034e-03,  1.3502e-02],
          [ 1.8976e-02,  8.4897e-03,  9.9239e-03],
          [ 2.7998e-02,  3.3866e-03,  3.0706e-02]],

         ...,

         [[ 2.1611e-02,  1.3576e-02, -2.2638e-03],
          [ 3.1981e-04,  5.5566e-03,  1.4303e-03],
          [-1.3221e-03, -2.6181e-03,  1.6269e-02]],

         [[ 9.1360e-03, -1.3612e-02,  1.0803e-02],
          [-1.7446e-02, -2.3003e-02,  6.0578e-03],
          [-1.7264e-02, -5.3412e-03,  1.1269e-03]],

         [[-1.2673e-02,  1.9370e-02,  2.2894e-03],
          [ 4.0198e-03,  1.6175e-03,  1.0278e-02],
          [-2.4483e-02, -2.5677e-02, -7.6767e-03]]],


        [[[-6.9262e-03, -5.6233e-03, -3.5152e-03],
          [-6.5375e-03, -1.4448e-02, -9.9792e-03],
          [-2.5880e-02, -1.3281e-02, -1.9598e-02]],

         [[-8.5774e-03, -2.0572e-02, -1.4821e-02],
          [ 1.8767e-02, -1.2778e-02, -1.5670e-02],
          [ 1.3260e-02, -3.0004e-03, -1.8270e-02]],

         [[ 1.7317e-02,  1.0014e-02,  1.5421e-02],
          [ 1.6499e-02, -1.4778e-02,  1.2397e-02],
          [-1.6704e-02, -2.5014e-02,  1.4771e-02]],

         ...,

         [[ 7.0394e-03,  1.2566e-02,  1.5867e-02],
          [ 9.8934e-03,  2.9302e-02,  4.7297e-03],
          [ 1.1337e-02, -1.9948e-03,  1.0692e-02]],

         [[ 3.4212e-03,  5.1473e-03, -1.4110e-02],
          [ 5.1296e-03, -1.3783e-02, -2.9022e-02],
          [-5.5250e-03,  6.1991e-03,  7.0356e-03]],

         [[ 3.5273e-03, -8.8340e-03, -2.1254e-02],
          [ 1.5234e-02, -8.9212e-03,  1.2711e-02],
          [-3.2081e-03, -2.3476e-02, -8.4571e-03]]],


        ...,


        [[[-2.8562e-02, -7.5180e-03,  1.4599e-02],
          [-2.0243e-02, -2.9485e-02,  5.4713e-05],
          [-2.6308e-03, -2.8685e-02, -1.9327e-02]],

         [[ 7.3137e-03, -6.8900e-03,  1.6473e-03],
          [ 2.3934e-02,  1.7293e-02,  1.8168e-02],
          [ 3.2893e-02,  3.2778e-02,  4.1614e-02]],

         [[ 1.5314e-03, -4.7585e-02,  3.9553e-02],
          [-2.2300e-02, -5.7313e-02,  2.5074e-02],
          [-4.3050e-02, -1.2614e-02,  2.3613e-02]],

         ...,

         [[-4.4826e-03,  4.6901e-03,  2.3574e-02],
          [-7.8160e-03, -1.0316e-02,  3.5899e-02],
          [ 2.1178e-02,  5.7244e-03, -1.8567e-03]],

         [[-5.9718e-04,  2.6017e-03,  3.9694e-02],
          [-3.0896e-03,  2.2937e-02,  3.3988e-02],
          [-3.9173e-02, -4.4933e-03,  9.7815e-03]],

         [[-4.7458e-02,  9.8044e-02,  2.5373e-02],
          [-6.1261e-02,  4.3155e-02,  1.6545e-02],
          [-5.1283e-02, -3.7696e-02, -4.9548e-02]]],


        [[[-4.3331e-02, -8.1990e-03, -5.3522e-02],
          [-2.2125e-02,  1.1858e-02, -3.4055e-02],
          [-3.6413e-02, -1.7979e-02, -4.2806e-02]],

         [[-2.5023e-03,  1.1622e-03, -4.5095e-03],
          [-1.5937e-02,  1.3033e-03, -1.4039e-03],
          [ 8.4911e-03,  1.6547e-02,  1.6302e-02]],

         [[ 3.4255e-02,  1.4493e-03, -2.0719e-02],
          [ 2.3174e-02, -2.6618e-02, -1.8910e-02],
          [ 8.0609e-03, -1.6315e-02,  1.3355e-03]],

         ...,

         [[ 1.6971e-02,  3.6007e-03, -4.9184e-03],
          [ 3.3523e-03,  1.8616e-02, -1.2742e-02],
          [-2.6226e-03,  1.0755e-02, -2.8754e-03]],

         [[-4.1152e-02, -1.6278e-02,  3.4659e-02],
          [ 1.4860e-02,  2.6478e-02,  6.8205e-02],
          [ 1.4101e-02,  4.9415e-02,  6.2358e-02]],

         [[-3.2522e-02,  8.4283e-03, -3.2296e-02],
          [-2.6740e-02,  6.3519e-02,  7.2680e-03],
          [-8.6290e-03,  5.3084e-02,  2.2354e-02]]],


        [[[-4.8128e-02,  4.9794e-03, -2.7731e-02],
          [-5.2834e-02, -1.6674e-02, -4.8823e-02],
          [-4.3085e-02, -4.8342e-03, -2.1020e-02]],

         [[-1.8078e-02,  7.5349e-03,  2.1894e-02],
          [ 2.0570e-03,  2.1014e-02,  2.7317e-02],
          [-4.4044e-03, -5.6735e-03, -1.1678e-02]],

         [[-3.9333e-03,  1.5431e-02,  3.1095e-03],
          [-3.4266e-02, -8.0041e-03, -4.0737e-02],
          [-1.0373e-02, -1.3137e-02, -2.5135e-02]],

         ...,

         [[-1.1422e-02, -1.1068e-02, -2.6556e-02],
          [ 5.5402e-04, -1.1401e-02, -2.5478e-02],
          [-1.0598e-02,  1.1776e-02,  2.3815e-02]],

         [[-2.0722e-02, -2.0430e-02, -1.3406e-02],
          [-2.9648e-02, -2.0838e-02, -3.3982e-02],
          [-2.5423e-02, -5.0160e-03, -1.6819e-02]],

         [[-2.8305e-02, -3.1576e-02, -4.5957e-02],
          [-2.3097e-02, -1.5578e-02, -2.3184e-02],
          [-2.1999e-02,  3.7065e-03,  2.3179e-03]]]])), ('features.12.bias', tensor([ 0.0081,  0.0008,  0.0921,  0.0401, -0.0459,  0.0429,  0.0023,  0.0654,
         0.0898,  0.0891,  0.0697,  0.2036, -0.1984, -0.0156, -0.0234, -0.0090,
        -0.0117,  0.0390, -0.0326,  0.2342,  0.1007,  0.0658,  0.0196,  0.1381,
        -0.1318,  0.0273,  0.2149,  0.0126,  0.0744,  0.1737, -0.1128,  0.1259,
         0.0321,  0.1362,  0.0060,  0.0778,  0.1610,  0.2223,  0.1665, -0.0132,
        -0.0238,  0.1425,  0.1552,  0.0869,  0.1412, -0.0429,  0.0677,  0.0206,
         0.1080,  0.2640,  0.1063, -0.0261, -0.0140,  0.1273,  0.0410, -0.1462,
        -0.0257,  0.0140,  0.0486, -0.0092,  0.0228,  0.0428,  0.0226,  0.0066,
         0.0014,  0.1270,  0.0320,  0.0989, -0.0172,  0.1474,  0.0830,  0.1477,
         0.2371,  0.0403, -0.0558,  0.0189,  0.0474, -0.0311,  0.0552,  0.0268,
         0.0219, -0.1241, -0.0402,  0.0836,  0.0670,  0.0083,  0.0702,  0.1147,
         0.1347, -0.0128,  0.2890,  0.1577, -0.1817, -0.0160, -0.0036,  0.0874,
         0.0404,  0.0438,  0.0861,  0.1154,  0.1607, -0.0231,  0.1155, -0.0018,
         0.0136,  0.0950,  0.0477, -0.0988,  0.0616,  0.0948, -0.0689, -0.0102,
         0.1182, -0.1292,  0.0223,  0.0818,  0.0722,  0.0156,  0.1165, -0.0359,
         0.0751,  0.0290,  0.0286, -0.0560,  0.1883,  0.0147,  0.1054,  0.1067,
        -0.1083,  0.0514,  0.1042,  0.0518,  0.1017,  0.1114,  0.0223, -0.0822,
        -0.0090,  0.0857,  0.0251, -0.0731,  0.1057,  0.1295,  0.0430,  0.0721,
         0.0236,  0.0671,  0.0714,  0.0003,  0.0366, -0.0715,  0.0393,  0.0395,
        -0.0209,  0.0509, -0.0400,  0.0318,  0.0060, -0.0212, -0.0153,  0.1134,
         0.0069,  0.0592, -0.0839, -0.0743, -0.1683, -0.0244,  0.1875,  0.0369,
         0.1861,  0.0996,  0.0322,  0.0711,  0.0483,  0.1173,  0.0322,  0.0079,
        -0.0453,  0.0019,  0.0067,  0.1854,  0.0722,  0.0462,  0.0480,  0.0030,
         0.1393,  0.0149, -0.0285,  0.0869,  0.0425, -0.0315,  0.0561,  0.1013,
         0.0567,  0.1636, -0.0591,  0.1075, -0.0456,  0.0341, -0.0290,  0.1095,
         0.1375, -0.0356,  0.0761,  0.0288,  0.0551,  0.1078, -0.0363,  0.2171,
         0.0526,  0.0696, -0.1063,  0.1262,  0.0418,  0.0290,  0.0689,  0.1373,
        -0.0678,  0.1006, -0.0019, -0.0919,  0.1378, -0.0968,  0.0735,  0.0374,
         0.0339, -0.0866,  0.0631,  0.0561,  0.0815,  0.0047, -0.0130,  0.0500,
        -0.1108,  0.0169,  0.1148,  0.0299,  0.0398,  0.1097,  0.0245,  0.0545,
        -0.1936,  0.1633,  0.0391, -0.0328,  0.1820,  0.0246,  0.0244,  0.0986,
        -0.0062,  0.0407, -0.0133,  0.0259,  0.1405,  0.0653, -0.0096,  0.0564])), ('features.14.weight', tensor([[[[-0.0155,  0.0034, -0.0208],
          [-0.0154,  0.0106, -0.0012],
          [-0.0046,  0.0178, -0.0036]],

         [[-0.0206,  0.0066, -0.0181],
          [ 0.0116, -0.0038, -0.0226],
          [ 0.0356, -0.0056, -0.0036]],

         [[ 0.0001, -0.0145,  0.0259],
          [ 0.0346,  0.0227,  0.0142],
          [ 0.0486,  0.0350,  0.0236]],

         ...,

         [[ 0.0004, -0.0091, -0.0099],
          [-0.0138,  0.0159,  0.0132],
          [-0.0383,  0.0032,  0.0217]],

         [[-0.0250, -0.0385, -0.0223],
          [-0.0498, -0.0494, -0.0421],
          [-0.0433, -0.0373, -0.0203]],

         [[ 0.0202,  0.0256,  0.0071],
          [ 0.0002,  0.0084,  0.0243],
          [ 0.0096,  0.0068,  0.0299]]],


        [[[ 0.0035, -0.0297, -0.0180],
          [-0.0055, -0.0111, -0.0139],
          [-0.0057, -0.0050,  0.0180]],

         [[ 0.0206,  0.0164,  0.0047],
          [ 0.0073, -0.0121, -0.0166],
          [-0.0284, -0.0446, -0.0417]],

         [[-0.0103, -0.0127, -0.0456],
          [ 0.0228,  0.0107, -0.0024],
          [ 0.0432,  0.0437,  0.0045]],

         ...,

         [[-0.0064,  0.0149,  0.0153],
          [-0.0197, -0.0077, -0.0082],
          [-0.0431, -0.0514, -0.0533]],

         [[-0.0083, -0.0209, -0.0198],
          [-0.0117, -0.0369, -0.0420],
          [ 0.0041, -0.0264, -0.0139]],

         [[ 0.0012, -0.0141,  0.0099],
          [-0.0099,  0.0026,  0.0137],
          [-0.0091, -0.0219, -0.0225]]],


        [[[-0.0026, -0.0110, -0.0143],
          [-0.0088,  0.0134, -0.0115],
          [-0.0059,  0.0095, -0.0092]],

         [[ 0.0043,  0.0160,  0.0076],
          [ 0.0087, -0.0036, -0.0117],
          [-0.0139, -0.0317, -0.0239]],

         [[-0.0228, -0.0144,  0.0040],
          [-0.0152,  0.0229,  0.0016],
          [ 0.0171,  0.0368,  0.0052]],

         ...,

         [[-0.0307, -0.0318,  0.0092],
          [-0.0025, -0.0352,  0.0248],
          [-0.0022, -0.0496,  0.0067]],

         [[-0.0238, -0.0304, -0.0117],
          [-0.0160, -0.0534, -0.0285],
          [-0.0202, -0.0389, -0.0290]],

         [[ 0.0012,  0.0030, -0.0082],
          [ 0.0119,  0.0235, -0.0012],
          [ 0.0316,  0.0985,  0.0112]]],


        ...,


        [[[-0.0140, -0.0101, -0.0068],
          [-0.0203, -0.0128, -0.0156],
          [ 0.0132,  0.0380,  0.0003]],

         [[ 0.0400,  0.0588,  0.0293],
          [-0.0021, -0.0102,  0.0251],
          [ 0.0239,  0.0076,  0.0139]],

         [[-0.0110, -0.0177, -0.0225],
          [ 0.0084, -0.0072, -0.0040],
          [ 0.0245,  0.0288,  0.0386]],

         ...,

         [[-0.0257,  0.0162,  0.0248],
          [-0.0309, -0.0531, -0.0038],
          [ 0.0115, -0.0205, -0.0375]],

         [[-0.0366, -0.0466, -0.0149],
          [-0.0095, -0.0091,  0.0004],
          [ 0.0051,  0.0243,  0.0338]],

         [[-0.0167, -0.0234,  0.0059],
          [-0.0096, -0.0118, -0.0073],
          [ 0.0377,  0.0049,  0.0104]]],


        [[[-0.0026,  0.0093, -0.0170],
          [ 0.0186,  0.0128, -0.0145],
          [ 0.0127,  0.0089, -0.0180]],

         [[-0.0024, -0.0154,  0.0187],
          [ 0.0314,  0.0011,  0.0186],
          [ 0.0314,  0.0315,  0.0257]],

         [[ 0.0145, -0.0050, -0.0023],
          [ 0.0153,  0.0001,  0.0007],
          [ 0.0055, -0.0118,  0.0134]],

         ...,

         [[ 0.0206,  0.0158, -0.0130],
          [-0.0167,  0.0069, -0.0166],
          [-0.0069,  0.0104, -0.0177]],

         [[ 0.0131, -0.0182, -0.0116],
          [ 0.0130, -0.0077, -0.0058],
          [ 0.0296, -0.0123,  0.0070]],

         [[-0.0069, -0.0300, -0.0034],
          [-0.0463, -0.0545,  0.0007],
          [-0.0487, -0.0396,  0.0036]]],


        [[[-0.0162, -0.0564, -0.0175],
          [-0.0174, -0.0550, -0.0238],
          [ 0.0310,  0.0137, -0.0105]],

         [[ 0.0491,  0.0133,  0.0053],
          [ 0.0197,  0.0342,  0.0044],
          [ 0.0079,  0.0057,  0.0301]],

         [[ 0.0128,  0.0056,  0.0155],
          [ 0.0344, -0.0082, -0.0097],
          [ 0.0366,  0.0003, -0.0246]],

         ...,

         [[-0.0080,  0.0117,  0.0118],
          [-0.0008,  0.0092,  0.0115],
          [-0.0109,  0.0008, -0.0158]],

         [[-0.0206, -0.0768, -0.0746],
          [-0.0025, -0.0355, -0.0422],
          [ 0.0171, -0.0114, -0.0314]],

         [[-0.0121, -0.0113,  0.0153],
          [-0.0141, -0.0066,  0.0138],
          [-0.0083, -0.0219, -0.0005]]]])), ('features.14.bias', tensor([ 0.1527,  0.0026,  0.0118,  0.0612,  0.0751,  0.0336,  0.0359,  0.1965,
        -0.0776, -0.0464,  0.0143, -0.0799, -0.1670, -0.0019,  0.2606,  0.1202,
        -0.0356, -0.0970,  0.1096,  0.3574, -0.1109, -0.1799,  0.0262,  0.0853,
         0.0695,  0.1890,  0.0186, -0.0910, -0.0431, -0.1330,  0.0615, -0.0163,
         0.0268,  0.0015,  0.0059,  0.3832, -0.0661, -0.0292,  0.1524,  0.0463,
         0.0012, -0.0849,  0.0185,  0.1371,  0.0122, -0.0279,  0.0299,  0.2400,
         0.0575,  0.0058, -0.0423, -0.0749,  0.0616,  0.0374, -0.0554,  0.2787,
        -0.0078,  0.0378,  0.0448,  0.0146,  0.1976, -0.0101,  0.1134, -0.0527,
         0.0147,  0.0263,  0.0608,  0.1433, -0.1462,  0.0421,  0.1858,  0.0425,
        -0.0079,  0.1064,  0.0585,  0.0768, -0.0239, -0.0044, -0.0805, -0.0221,
         0.1140, -0.0683, -0.0827, -0.0357, -0.0555,  0.3748,  0.0047,  0.4622,
        -0.1137,  0.0499, -0.0782, -0.0067, -0.1540,  0.0021,  0.0214,  0.2276,
        -0.0322, -0.1061,  0.0281,  0.0258,  0.0006,  0.0171, -0.0165, -0.0237,
         0.0153, -0.1518,  0.0878, -0.0198, -0.0478,  0.0325, -0.0095, -0.0673,
         0.0015, -0.0601, -0.0157,  0.0288,  0.3301, -0.0207,  0.1275,  0.0270,
         0.1409, -0.0736, -0.0761,  0.0053, -0.1070,  0.0598, -0.0250,  0.3023,
        -0.0699,  0.0256,  0.1078, -0.0116, -0.0383, -0.0591, -0.1085,  0.0720,
        -0.0430,  0.2818,  0.0155, -0.0255, -0.0499,  0.0225,  0.0256,  0.1965,
         0.0169, -0.0636, -0.0493,  0.2131,  0.0348,  0.0979,  0.0510, -0.0073,
        -0.0826, -0.0063, -0.0395,  0.0054,  0.1830,  0.0029,  0.0332,  0.2406,
         0.0567,  0.0066, -0.1359, -0.0163,  0.1877, -0.0564, -0.1024, -0.0884,
         0.0464,  0.1190, -0.1196,  0.0211, -0.0810,  0.0997, -0.1556, -0.0740,
        -0.0100, -0.0201,  0.0839, -0.0453,  0.0081,  0.0599, -0.0338,  0.2230,
        -0.1076,  0.0043,  0.0065, -0.0494, -0.0767,  0.0475, -0.0149,  0.2279,
        -0.0490, -0.0124, -0.0288, -0.0238,  0.0233, -0.0998,  0.0037,  0.3284,
        -0.0424,  0.3322,  0.0159, -0.0710,  0.0465,  0.0838,  0.0332,  0.1902,
         0.0334, -0.0613,  0.1509,  0.0363,  0.1291, -0.1115, -0.0433,  0.0450,
        -0.0986,  0.0771,  0.0814,  0.0824, -0.0308, -0.0128, -0.0068, -0.0059,
        -0.0202,  0.0106, -0.1317,  0.1157, -0.1242, -0.0816, -0.0769, -0.0481,
         0.0572,  0.1796, -0.0352, -0.0285,  0.0144,  0.1194, -0.0091,  0.1399,
        -0.0381,  0.0255, -0.0679,  0.0725,  0.0707,  0.0324,  0.0248, -0.0288,
        -0.0367,  0.1565,  0.0469, -0.0201, -0.0677, -0.0388, -0.1451, -0.1943])), ('features.17.weight', tensor([[[[-7.0407e-03, -1.2371e-02,  2.2388e-03],
          [-3.4945e-04,  8.3066e-03, -3.3719e-03],
          [ 1.4878e-03,  1.1629e-02,  1.7914e-02]],

         [[ 1.7044e-02,  1.3268e-02,  1.6129e-02],
          [-9.7721e-04, -1.2761e-03,  5.3491e-03],
          [-4.9739e-03,  6.8304e-03, -1.4400e-02]],

         [[-1.3706e-02, -1.5852e-02, -7.2444e-03],
          [ 1.1695e-02,  7.9012e-03,  3.7443e-03],
          [ 3.4724e-03,  1.2283e-02,  1.2933e-02]],

         ...,

         [[ 6.5974e-02,  6.9182e-02,  6.9327e-02],
          [ 4.5527e-02, -1.3160e-03,  6.0608e-02],
          [ 7.0592e-02,  5.3374e-02,  2.0030e-02]],

         [[ 1.4789e-02, -1.7400e-02, -2.3320e-02],
          [ 1.1156e-02,  1.5264e-02, -9.4171e-03],
          [ 2.1255e-02,  1.4230e-02, -1.3540e-02]],

         [[-2.0577e-02, -9.5674e-03,  6.9175e-03],
          [-7.2709e-03, -1.7179e-02,  2.0196e-02],
          [ 1.7350e-02,  5.2181e-03, -1.2872e-02]]],


        [[[-1.0917e-02, -1.6156e-02, -4.3484e-03],
          [-2.5008e-02, -4.2966e-02, -3.0563e-02],
          [-2.6327e-02, -2.4413e-02, -8.5690e-03]],

         [[-3.7772e-02, -1.2624e-02, -2.0013e-02],
          [-3.3966e-02, -1.6831e-02, -1.0124e-02],
          [-1.8217e-02, -1.5020e-02,  1.3080e-03]],

         [[ 1.2184e-02, -1.2087e-02,  1.7991e-02],
          [ 5.2722e-02,  8.0374e-03,  2.2514e-02],
          [ 5.8993e-02,  3.2782e-02,  2.1087e-02]],

         ...,

         [[-4.8349e-03, -4.7245e-03,  2.4834e-02],
          [-7.2375e-03, -1.1020e-02,  1.7923e-02],
          [ 2.6053e-02, -1.8564e-02, -2.8714e-03]],

         [[ 1.6234e-02, -3.4470e-02, -1.4160e-02],
          [ 2.6344e-03, -3.5605e-02, -4.0918e-02],
          [ 3.2230e-03, -1.3359e-02, -1.6670e-02]],

         [[-2.8010e-02, -1.8247e-02, -1.0266e-02],
          [-2.4739e-02, -4.9246e-02, -2.1506e-02],
          [-3.2995e-02, -3.5000e-02, -2.9097e-02]]],


        [[[ 6.9750e-03,  2.6729e-02,  3.2822e-02],
          [ 3.6466e-03, -1.7902e-02, -4.3422e-03],
          [-8.5616e-03, -1.7390e-02, -6.4783e-03]],

         [[-2.4613e-02, -1.8950e-02, -2.5066e-02],
          [-1.7697e-02, -9.3534e-03, -6.0126e-03],
          [ 9.1716e-03, -2.1026e-03,  8.8393e-03]],

         [[-8.2647e-03, -1.0965e-02,  1.1624e-02],
          [ 1.5643e-02, -1.4625e-02,  3.9084e-03],
          [ 3.4610e-02, -3.9968e-03,  1.7886e-03]],

         ...,

         [[-1.8449e-02, -2.2875e-02, -3.0008e-02],
          [-3.7424e-02, -4.2076e-02, -5.0794e-02],
          [-1.4039e-02,  4.4702e-02,  7.4715e-02]],

         [[ 3.3004e-03,  7.3116e-03,  3.0886e-03],
          [-4.4847e-02, -5.6967e-03, -1.3882e-02],
          [-2.5696e-02, -2.6993e-02,  6.3057e-03]],

         [[ 1.8556e-03, -1.5118e-02,  2.4970e-03],
          [ 4.8854e-02,  2.7233e-02, -2.2185e-02],
          [ 1.1909e-02,  5.5265e-03, -2.7282e-02]]],


        ...,


        [[[ 7.5810e-03, -9.0366e-03,  1.4369e-03],
          [-4.1151e-03, -5.4969e-03,  1.4365e-02],
          [-1.1409e-03,  2.9281e-03,  4.0953e-03]],

         [[-4.2916e-02, -3.9380e-02, -1.5347e-02],
          [-3.2325e-02, -1.0138e-02, -8.9602e-03],
          [-6.7189e-03,  9.2747e-03,  3.9578e-03]],

         [[ 6.2547e-03,  2.0394e-02,  3.2767e-02],
          [-9.7907e-03, -4.7231e-03,  3.3003e-02],
          [-7.1901e-03, -9.9433e-03, -3.3229e-03]],

         ...,

         [[ 1.7658e-02,  4.6615e-02,  9.7046e-03],
          [ 2.7706e-03,  1.7994e-03, -3.2915e-03],
          [-3.6330e-05,  1.3310e-02, -3.9286e-03]],

         [[-6.9039e-03,  6.3574e-03,  1.6824e-02],
          [-2.9717e-02, -2.2547e-02,  7.5127e-03],
          [ 1.7091e-03, -2.6405e-02, -7.0685e-03]],

         [[ 7.4595e-03,  1.0742e-02, -3.1499e-04],
          [-6.9448e-03, -2.4510e-02, -2.4144e-02],
          [-3.1542e-02, -1.5262e-02, -1.4584e-02]]],


        [[[ 4.9512e-02,  2.3043e-02,  2.2162e-02],
          [-1.2518e-03, -3.5788e-03,  6.6051e-03],
          [ 1.4536e-02,  1.2092e-02,  1.0204e-02]],

         [[-5.4716e-05, -9.5875e-03,  1.0365e-02],
          [-8.1047e-03, -2.0313e-02, -4.4185e-03],
          [ 1.3795e-02,  1.4303e-03,  1.5385e-02]],

         [[ 2.8190e-03, -1.0707e-02, -1.1369e-03],
          [-2.1748e-03, -2.2595e-02, -1.0350e-02],
          [-2.2768e-02, -1.3309e-02, -9.0804e-03]],

         ...,

         [[ 4.8838e-02,  2.8987e-02,  1.6121e-02],
          [ 1.1093e-02, -2.4850e-02, -2.4911e-02],
          [ 5.4552e-03, -4.9657e-03, -1.5505e-02]],

         [[ 5.5599e-03, -3.9190e-02, -2.5970e-02],
          [-1.9628e-02, -4.3369e-02, -1.1961e-02],
          [-1.9965e-02, -3.1207e-02,  4.5270e-04]],

         [[ 1.1173e-02,  8.0449e-04,  9.5013e-03],
          [-1.9043e-02, -2.9472e-02, -1.4361e-02],
          [-3.0420e-02, -1.2566e-02, -1.6186e-02]]],


        [[[-1.5104e-03, -3.1250e-03, -1.4089e-02],
          [-2.5407e-03,  4.5601e-03, -3.2633e-02],
          [ 9.2935e-03, -2.8452e-03,  1.9294e-03]],

         [[-1.2509e-02, -1.7259e-02,  1.3495e-03],
          [ 5.4679e-03, -5.5054e-03,  2.3635e-02],
          [ 5.8567e-03,  1.2592e-02,  2.7611e-02]],

         [[-1.3583e-02, -4.1725e-02, -3.4188e-02],
          [-1.9751e-02, -3.7626e-02, -2.4501e-02],
          [-5.7688e-03, -2.1353e-02, -4.6215e-03]],

         ...,

         [[ 1.1298e-02, -5.5083e-03, -1.7650e-02],
          [-7.7781e-03, -3.0555e-02, -2.7287e-02],
          [-2.6451e-02, -4.3400e-02, -2.3002e-02]],

         [[-2.6287e-03, -1.7704e-02, -2.6902e-02],
          [-4.5120e-03, -4.0293e-02, -2.8228e-02],
          [-1.3612e-02, -2.6651e-02, -7.3693e-03]],

         [[-9.8540e-03, -1.2848e-02, -8.3328e-04],
          [-1.2088e-02, -1.4440e-02,  1.5528e-02],
          [-2.7315e-02,  5.2576e-03,  2.6680e-02]]]])), ('features.17.bias', tensor([ 6.2630e-02, -6.2566e-03, -9.5154e-02,  6.4328e-02,  5.0604e-02,
         1.8327e-01,  1.2081e-01,  3.9497e-02,  1.2995e-01, -1.3335e-01,
         2.9477e-01,  1.0096e-02, -2.2026e-02, -2.4025e-02, -8.8757e-02,
        -1.2469e-01, -2.6338e-02,  1.2272e-02,  4.2654e-02,  2.2218e-02,
         7.9092e-02,  5.8674e-02, -4.9218e-02,  3.2132e-02,  2.7338e-03,
        -6.4431e-02, -2.5716e-02, -2.5200e-02,  6.7211e-02,  2.0753e-02,
        -3.7940e-02, -1.2187e-02, -4.8100e-02, -1.3841e-01, -9.5291e-02,
        -1.7405e-02, -3.6244e-02, -1.3165e-02,  1.0913e-01, -3.8103e-02,
         1.1590e-02, -1.6605e-02, -4.3746e-02, -4.6994e-02, -6.2096e-02,
        -1.5154e-01, -9.5747e-02, -4.6606e-02, -6.6613e-02,  4.0910e-01,
        -1.3951e-02,  5.8377e-03, -1.0199e-01, -4.1269e-02,  6.6074e-03,
        -2.0249e-02,  7.1135e-02, -5.4637e-02,  4.8560e-03,  5.7287e-02,
         6.7055e-03, -1.1529e-03,  5.6607e-02, -6.2156e-02,  5.4827e-02,
         5.0320e-02,  6.2363e-03,  2.5100e-01, -3.2767e-02, -3.2222e-01,
        -8.2089e-02, -8.2794e-02,  5.0875e-02,  1.5371e-01,  1.5838e-01,
         9.6299e-02,  4.4111e-02, -9.3503e-02, -4.1314e-02, -6.7891e-02,
         7.4247e-02, -6.7585e-02,  9.1610e-02, -4.3105e-02, -1.7745e-02,
        -3.2365e-02, -2.2697e-01, -1.8510e-02, -2.1880e-03,  3.1550e-02,
         6.3727e-02,  4.1032e-02,  3.5628e-02, -1.5736e-02, -3.9801e-02,
         7.6651e-02, -2.4468e-02,  1.7755e-02,  4.5166e-02, -7.7999e-02,
        -1.2810e-01,  5.5851e-03, -3.6472e-02, -7.2317e-02,  1.5489e-02,
         3.0743e-02,  1.2406e-02,  3.5693e-03,  7.0128e-03,  1.1360e-02,
         1.2189e-02,  1.7629e-02, -4.9695e-02,  2.9514e-01,  7.7049e-02,
         1.2381e-01,  2.9648e-01,  5.6095e-03, -9.5551e-02, -5.5258e-02,
        -4.8147e-02,  4.4906e-02,  5.3674e-03, -4.0218e-02, -2.7745e-02,
         7.8927e-02,  3.4750e-02,  2.0862e-01, -5.5249e-02,  9.2615e-02,
         2.5378e-02, -1.1578e-02, -9.1153e-03, -4.7815e-02,  7.5379e-03,
         4.1849e-02, -2.6778e-02, -1.6734e-01,  1.5851e-02,  1.0453e-01,
        -1.2898e-02,  2.8317e-02, -1.0005e-01,  4.8676e-03,  6.8762e-02,
        -1.7776e-02, -7.6952e-02, -6.7671e-02, -2.1532e-01,  1.6099e-01,
        -2.2366e-02,  2.8839e-01,  1.2463e-01, -7.8280e-02, -6.7696e-02,
        -1.5392e-02,  2.7303e-01, -1.7751e-02,  6.3972e-02, -1.6900e-02,
        -4.4733e-02, -6.5058e-02, -2.8436e-02,  5.2585e-02, -1.7819e-01,
        -1.3598e-02, -8.1296e-02,  1.7016e-01,  6.5367e-02, -5.1451e-02,
        -1.9416e-01,  2.6761e-02, -1.7197e-02,  1.4929e-01,  3.7100e-02,
        -5.5770e-02,  1.1710e-01,  8.2504e-03,  9.1099e-02,  3.5156e-02,
        -1.8383e-03,  2.4381e-02,  6.6448e-04,  2.3547e-03, -4.6125e-02,
        -1.5554e-01,  1.4569e-01,  1.3094e-01,  7.5967e-02,  4.9593e-02,
        -1.1754e-01,  7.9274e-02,  1.8338e-01,  1.4139e-02,  3.5021e-02,
        -1.5334e-01,  2.8388e-01, -3.1315e-02,  2.7762e-02,  2.2338e-01,
         2.2379e-01,  2.7575e-02, -1.7353e-02,  6.6190e-02, -1.4153e-02,
         3.4527e-02,  2.2380e-01, -8.0898e-02, -1.0985e-01, -5.3484e-02,
        -1.3191e-01,  2.8662e-03,  4.6227e-01, -9.5797e-02, -4.0930e-02,
         1.2140e-01,  5.0590e-02, -2.0373e-02, -9.4393e-03,  1.5747e-02,
        -1.3306e-01, -2.3312e-02, -4.7898e-02, -8.1193e-02, -3.3583e-02,
         1.6073e-02,  7.3700e-02, -4.9819e-02, -8.0139e-03, -8.4200e-03,
        -1.1419e-01,  3.2303e-03, -1.3205e-01, -5.2488e-02,  2.3260e-03,
        -8.2563e-02,  2.9214e-02,  8.5484e-05, -8.0803e-02,  8.5734e-02,
        -3.0113e-02,  3.3095e-02, -5.3173e-02,  9.1359e-03,  2.9478e-02,
        -2.5184e-02, -1.2302e-02, -1.7977e-01, -3.6971e-02, -1.3840e-02,
        -2.4956e-01,  5.0414e-03, -3.7441e-02,  1.5297e-01,  6.9945e-02,
         3.8480e-02, -1.5420e-01,  1.0126e-01,  8.8586e-02, -5.2075e-02,
        -3.4113e-02,  1.3338e-01, -6.2594e-03,  5.5215e-02, -3.4489e-02,
         5.4913e-03,  1.8711e-03,  1.0383e-01, -4.5990e-02, -7.4082e-02,
         3.0732e-02,  1.0529e-01, -1.3858e-01, -1.2477e-03, -4.1135e-04,
         9.1124e-03, -4.6323e-02,  6.6734e-04, -2.7023e-03,  8.9828e-02,
        -2.7475e-02, -9.0151e-02, -5.8980e-02,  2.1231e-01, -4.4924e-02,
         2.0364e-02, -4.3869e-02,  9.3140e-03,  7.3586e-02, -8.7737e-02,
         8.8909e-03, -1.8896e-02, -2.1631e-01,  9.3183e-02, -1.3093e-01,
        -1.8491e-01, -3.7379e-02,  5.4902e-02,  2.0206e-02,  2.0681e-02,
        -2.0113e-02,  1.4271e-01, -4.7136e-04,  1.0624e-03,  9.0683e-02,
        -1.2395e-01, -3.4734e-02, -3.1123e-02,  2.4467e-01, -1.2942e-01,
        -3.4137e-02, -2.9040e-02,  6.4992e-02,  3.8564e-02,  1.1797e-01,
        -8.0304e-03, -9.3801e-02,  6.8520e-02,  2.1830e-02,  1.5698e-01,
         2.2785e-03, -9.0569e-02,  2.1953e-02,  1.0814e-02,  1.7791e-03,
         3.1800e-01, -1.9108e-02, -6.5618e-02,  7.6786e-03, -1.0349e-01,
        -3.9480e-03, -8.8860e-03, -1.3378e-02,  4.2281e-02,  1.1424e-01,
         2.8361e-01, -7.3144e-02,  4.0058e-02,  1.2552e-01,  9.1824e-03,
        -1.2902e-01, -1.5494e-01, -3.9942e-02, -9.9273e-02, -8.9162e-02,
         8.3584e-02, -4.1889e-02,  6.9821e-02,  1.2279e-01, -8.4987e-02,
        -6.6632e-02,  7.0565e-02, -1.4372e-01,  5.8389e-02,  5.2051e-02,
        -8.9793e-02, -1.1338e-01, -1.9009e-02,  3.2576e-02, -6.1294e-02,
         1.6543e-01,  8.1262e-02, -1.9153e-01, -1.6996e-02, -6.4067e-03,
         4.0050e-02,  1.5593e-01, -1.1438e-01,  1.3713e-01,  3.1640e-02,
         1.0470e-01,  2.3170e-03,  1.9655e-01, -2.2174e-02, -1.4331e-02,
         1.0551e-01, -8.7134e-02, -8.6777e-02, -6.7960e-02, -1.8113e-01,
         4.7958e-02, -4.2129e-02, -1.1096e-01,  2.6425e-01, -1.5025e-02,
         2.8779e-02,  1.3790e-01, -4.2245e-02,  3.8898e-02,  1.7363e-01,
        -5.6602e-02, -7.0436e-02,  8.6140e-02,  8.3959e-02, -9.0827e-02,
        -5.0942e-02, -5.6560e-02, -3.2493e-02, -4.1888e-02, -2.3820e-02,
         1.7373e-01, -5.6791e-02, -4.0089e-02,  4.4692e-02,  5.8470e-03,
         1.1869e-01, -9.9367e-02,  1.0134e-01, -3.4385e-02,  3.2599e-02,
        -7.0188e-02, -8.2939e-02,  4.2470e-02,  4.9906e-02, -1.2907e-01,
        -1.0754e-01, -5.3669e-02,  2.0852e-02,  2.8985e-02,  1.2880e-02,
        -8.5557e-03,  1.1347e-01,  5.1852e-02,  7.4684e-02,  4.8715e-02,
         1.1101e-01, -5.6256e-02,  2.0418e-01, -5.2352e-02,  2.1019e-01,
         7.7646e-02,  6.8654e-02, -4.9674e-02, -1.0711e-02, -6.9467e-02,
         2.0559e-01, -4.3798e-02,  6.3782e-02, -1.5429e-01, -4.0386e-02,
         2.5244e-02, -8.2869e-02, -1.1579e-02, -7.2033e-02,  1.7581e-01,
        -3.5858e-02,  3.7866e-02, -5.2666e-03,  4.5334e-02, -6.5432e-02,
        -1.1455e-01,  2.1535e-01, -2.3169e-02,  9.2674e-03,  2.5537e-02,
        -1.3971e-02, -1.6709e-01, -8.7050e-02,  1.0423e-01,  3.0700e-01,
        -9.9891e-02, -8.8479e-02, -1.3738e-02, -1.2333e-02, -3.9320e-02,
        -2.8744e-02, -7.7326e-02,  1.8170e-02, -6.9338e-02,  2.8836e-02,
        -6.8453e-02,  5.1214e-02, -6.9454e-02,  1.1975e-02, -4.2582e-02,
        -7.5787e-02, -1.7702e-01, -5.8028e-02, -1.4638e-01,  4.3677e-02,
         3.7741e-03, -7.6761e-02, -8.2503e-02, -7.3439e-04,  1.1584e-01,
         2.5212e-02, -1.7453e-01,  1.3903e-01,  1.1208e-01, -1.3188e-01,
         6.6298e-02,  6.0701e-03, -7.4587e-02, -2.9380e-03, -7.1081e-02,
         2.5348e-02, -5.3189e-02, -3.0765e-02, -7.2377e-02,  4.1903e-01,
        -7.2105e-02,  3.8079e-02,  2.1747e-01, -2.1013e-02, -2.7792e-03,
        -9.6949e-02,  1.9648e-03, -9.0626e-02,  6.9204e-02, -8.3690e-02,
        -4.8536e-02, -1.1388e-02])), ('features.19.weight', tensor([[[[-2.5535e-03, -1.1158e-02, -8.2769e-03],
          [ 7.9291e-03, -3.0797e-03, -1.7211e-02],
          [ 2.1517e-02, -6.8554e-03, -2.0203e-02]],

         [[ 1.7328e-02,  1.3599e-02,  2.5407e-02],
          [ 5.3267e-03,  1.1174e-02,  7.7055e-03],
          [ 2.3977e-02,  2.4697e-02,  1.7318e-02]],

         [[-1.0630e-02, -2.0177e-02, -2.8308e-02],
          [ 2.3042e-02,  1.2405e-02, -1.9934e-02],
          [ 1.9213e-02, -1.2397e-02, -3.3434e-02]],

         ...,

         [[-2.6772e-02, -1.8914e-02, -3.7924e-02],
          [-2.5502e-02, -3.1720e-02, -2.6252e-02],
          [-2.4845e-02, -1.8907e-02, -1.9230e-02]],

         [[-1.1758e-02, -2.0107e-02, -1.0928e-02],
          [-4.7293e-03,  1.3684e-03, -4.3430e-03],
          [ 1.3007e-02,  1.9641e-03, -4.9493e-03]],

         [[-1.1713e-02, -1.2694e-04,  8.5288e-04],
          [-4.5545e-04,  1.5829e-02,  1.3876e-02],
          [-1.1323e-02,  2.0346e-02,  6.9136e-03]]],


        [[[ 8.9240e-03, -1.9465e-02, -1.7367e-02],
          [ 5.8091e-04,  3.8840e-03,  2.4610e-02],
          [-1.8340e-02,  1.6218e-02,  2.9450e-02]],

         [[ 3.4527e-03, -1.0844e-02, -3.3924e-03],
          [ 1.0002e-02, -1.9492e-03,  1.1047e-02],
          [ 3.6633e-03,  6.9817e-03,  1.9736e-02]],

         [[-3.8001e-02, -1.4251e-02,  2.6339e-03],
          [-3.6224e-02,  2.2680e-02,  3.3290e-02],
          [-1.0769e-02,  1.2441e-02, -4.9949e-03]],

         ...,

         [[ 3.9896e-03, -6.4058e-03, -2.4101e-02],
          [ 1.2791e-02, -2.0637e-02, -2.6050e-02],
          [-2.7292e-03, -1.5665e-02, -4.9022e-03]],

         [[ 2.3085e-02,  9.5574e-03, -7.8941e-03],
          [ 7.1988e-03, -8.5825e-03, -3.2298e-03],
          [-2.0175e-02, -9.5496e-03, -4.6666e-03]],

         [[-2.0695e-02,  8.8610e-03,  5.2169e-03],
          [-5.8898e-03,  1.4058e-02,  5.3525e-03],
          [-1.4002e-02, -1.2316e-03,  7.7627e-05]]],


        [[[-5.8429e-03,  2.7116e-03,  2.3624e-02],
          [-4.1978e-03, -9.0837e-03,  2.5292e-03],
          [ 1.2860e-02,  6.1783e-03,  1.3395e-02]],

         [[ 2.6529e-02,  1.9222e-02,  1.7867e-02],
          [ 8.9680e-03,  1.4672e-02, -7.2351e-04],
          [-1.3411e-02, -3.4650e-03, -6.1179e-03]],

         [[ 1.7954e-02, -6.7881e-03,  3.9998e-03],
          [ 1.2262e-02,  4.4036e-03,  5.8230e-03],
          [ 8.0924e-03,  9.9460e-03,  1.5369e-02]],

         ...,

         [[ 1.3355e-02, -4.9726e-03, -2.5974e-02],
          [ 1.8754e-02,  1.0445e-02, -4.4697e-04],
          [-1.1814e-02, -6.5553e-03, -2.6682e-03]],

         [[-2.2084e-02, -9.9309e-03, -1.2186e-02],
          [-8.3404e-03, -8.9806e-03, -5.7598e-03],
          [-3.5855e-03, -4.3484e-03, -4.0049e-03]],

         [[-1.0454e-03,  1.1157e-02,  1.2471e-02],
          [-2.7479e-04,  3.7508e-03,  1.3845e-02],
          [ 2.7957e-03, -1.5454e-03,  1.0712e-02]]],


        ...,


        [[[-1.6992e-02, -2.6317e-03, -7.9817e-03],
          [ 2.4494e-03,  2.6524e-02,  1.9120e-02],
          [ 1.5663e-02,  3.9729e-02,  4.4346e-02]],

         [[ 1.5429e-02,  9.7136e-03,  1.5909e-02],
          [-1.8311e-02,  6.4525e-03,  1.9531e-02],
          [-1.6276e-02, -8.5435e-03, -2.8023e-03]],

         [[-1.1841e-02, -1.3319e-02, -2.5728e-02],
          [-7.2776e-03, -1.2659e-02, -1.2658e-02],
          [-3.5886e-03, -3.3302e-03,  3.1721e-03]],

         ...,

         [[ 4.8700e-04, -1.0890e-03, -8.2800e-03],
          [-1.0539e-02, -1.0870e-02, -1.2052e-02],
          [-2.7241e-02, -2.3530e-02, -9.9151e-03]],

         [[ 7.9957e-03,  3.4473e-03,  2.3797e-02],
          [-1.9361e-02, -1.4075e-02, -7.2387e-03],
          [-3.0355e-02, -2.7729e-02, -7.0975e-03]],

         [[ 1.6241e-02,  5.0342e-03, -5.4142e-03],
          [-8.1496e-03, -5.3835e-03, -1.0105e-02],
          [-1.8767e-02, -9.4346e-03, -1.6970e-02]]],


        [[[-2.2802e-03, -8.8761e-03, -2.2022e-02],
          [ 1.7355e-02,  1.4267e-02, -5.1140e-03],
          [ 8.5410e-03, -1.5400e-04,  3.2840e-03]],

         [[-3.5262e-03, -1.5919e-02,  2.0676e-02],
          [-2.5445e-03,  1.6820e-03,  1.6177e-02],
          [-3.4168e-03, -6.6551e-03, -7.9188e-03]],

         [[ 3.0259e-02,  2.8690e-02,  3.0252e-02],
          [-1.8220e-02, -9.3668e-03,  2.9770e-02],
          [-2.1978e-02, -4.9280e-03,  2.1961e-02]],

         ...,

         [[-1.8668e-02, -1.5138e-02,  8.6974e-03],
          [-1.4765e-02, -2.3513e-02,  1.1347e-03],
          [-1.4733e-02, -3.1786e-02, -2.6354e-03]],

         [[ 1.5800e-02,  1.3073e-02,  3.2280e-02],
          [ 1.2601e-02,  1.1681e-02,  1.1965e-02],
          [ 3.5136e-03,  4.3679e-03, -2.2507e-03]],

         [[ 2.8722e-04,  4.1636e-03,  1.7368e-02],
          [-1.7108e-02,  3.4045e-03,  3.0699e-02],
          [-2.1262e-02, -2.2950e-02,  1.6036e-02]]],


        [[[-5.1554e-03, -4.7330e-04,  9.6674e-03],
          [ 1.3853e-04, -9.1627e-03, -1.6065e-03],
          [-1.4993e-03, -8.4020e-03,  1.5302e-02]],

         [[ 1.3718e-02,  1.3465e-02,  1.9703e-02],
          [ 9.3828e-03,  4.3403e-02,  4.0656e-02],
          [-1.7159e-02,  8.0563e-03,  3.4450e-03]],

         [[-1.5223e-03,  3.1755e-02,  2.9220e-02],
          [ 1.0546e-02,  1.4674e-02,  2.5458e-03],
          [-5.4571e-03, -8.4497e-03, -6.3715e-03]],

         ...,

         [[-8.9381e-04, -2.2163e-03,  2.0394e-02],
          [-1.3424e-02, -1.4380e-02,  2.3028e-02],
          [-1.1290e-02, -1.5281e-02, -9.1222e-03]],

         [[ 1.4791e-02,  2.7121e-02,  1.8470e-02],
          [-1.2051e-02,  4.4541e-03,  6.4978e-04],
          [-7.1708e-03, -1.5393e-02, -1.3675e-02]],

         [[ 2.5665e-02,  2.3979e-02,  1.5356e-02],
          [-2.4473e-03, -8.8645e-03, -5.5669e-03],
          [-2.3476e-02, -1.9197e-02, -2.3337e-03]]]])), ('features.19.bias', tensor([-1.1752e-01,  9.3718e-03,  1.1343e-01,  1.2496e-02, -8.0347e-02,
        -3.8229e-02,  2.5911e-02,  1.7084e-02, -3.2369e-02, -1.7167e-02,
         3.6917e-02,  5.6103e-02, -3.6792e-02, -7.3691e-02, -2.3732e-02,
         7.0886e-02,  1.3879e-01,  8.3961e-03,  1.0029e-01,  1.1617e-01,
         9.5724e-02, -1.5288e-01, -8.2482e-02,  7.5386e-02,  4.3616e-02,
         3.5308e-02, -5.1831e-02,  5.5101e-02,  1.0002e-01, -1.2884e+00,
         5.3676e-04,  4.9927e-02,  6.3197e-02,  1.0285e-01,  2.3175e-01,
         8.1985e-03,  2.7595e-02,  8.3366e-02,  1.2768e-01,  1.3917e-01,
         1.4572e-01,  2.9283e-02, -1.3841e-01,  2.5616e-02, -6.9595e-02,
        -1.3612e-01,  3.1376e-02,  9.8765e-02,  8.2654e-02,  8.4328e-02,
         1.3563e-01,  5.0649e-02,  1.2511e-02,  1.5002e-01, -6.7553e-02,
         4.3009e-02, -1.8281e-03,  1.6613e-01, -9.1294e-02,  7.8736e-02,
         8.7640e-02,  1.0324e-02, -1.7400e-01,  1.0301e-01,  1.9302e-01,
         5.4685e-02, -2.9570e-02,  2.8155e-02,  2.4079e-01,  1.0872e-01,
         5.2928e-02,  7.9099e-02,  8.8713e-02,  1.0865e-02, -5.1822e-02,
        -3.7291e-02,  2.6983e-01,  3.0904e-03,  2.8206e-03,  2.0598e-01,
        -2.5845e-03,  1.3051e-04, -2.2920e-01,  2.2763e-01,  3.3266e-02,
        -1.0871e-01,  6.8843e-02, -3.3600e-02,  8.5373e-02, -2.2240e-02,
         1.3290e-01, -1.5021e-02, -2.1608e-01, -5.1593e-02,  2.9458e-01,
        -5.8781e-02, -1.1782e-02, -3.7792e-02,  4.2807e-02,  4.9526e-02,
         1.9662e-01, -1.9459e-01,  5.0997e-02, -2.3870e-02,  5.9481e-02,
        -9.4280e-02,  1.2516e-01,  5.8879e-02, -3.8560e-02,  6.0303e-03,
        -1.1376e-03,  9.4548e-02,  5.5031e-02,  3.3100e-01,  1.0379e-01,
         7.5330e-03,  1.0166e-01, -4.6531e-02,  1.7130e-01,  1.6491e-01,
         1.7477e-01, -3.7272e-03,  8.3344e-02,  1.2243e-01,  1.3192e-02,
         6.0393e-02,  1.3215e-01, -2.8612e-01,  2.1367e-01, -4.4983e-02,
         7.6503e-02,  4.0292e-02, -5.4988e-02,  2.7456e-01,  8.8115e-02,
         4.4357e-02,  1.3897e-01,  3.0585e-02,  2.1787e-02,  1.6900e-02,
         1.5338e-02,  2.2825e-01, -3.6196e-02, -3.0091e-02,  3.5445e-02,
         2.2176e-02,  2.2434e-01, -3.0888e-02,  8.1282e-02,  9.7392e-02,
         8.2857e-02,  1.0359e-02,  9.7639e-02,  4.7845e-02, -2.3539e-01,
         9.2643e-02,  5.1654e-02, -9.9514e-02,  5.7799e-02,  1.0307e-01,
         9.1732e-02,  1.2984e-02,  3.6802e-02,  1.1253e-01,  1.9391e-02,
        -1.1692e-01,  3.9203e-01, -6.3642e-02,  1.1514e-01, -1.5983e-01,
         1.2919e-01,  1.7574e-01,  1.2229e-02, -5.7805e-02,  1.7859e-01,
         8.7310e-02,  1.9079e-01,  3.7651e-02,  2.8623e-02,  5.9517e-02,
        -2.1159e-01,  3.4242e-02, -1.0591e-02,  2.5614e-02,  1.0470e-01,
        -5.5612e-02, -2.0477e-02,  6.9557e-02,  1.8120e-01, -6.2036e-03,
        -9.7789e-02, -2.1976e-02, -3.1304e-03,  6.2532e-02,  1.1730e-02,
        -3.4909e-03,  4.2647e-02,  9.3915e-02,  1.2538e-01,  4.1627e-02,
         7.6311e-02,  1.2136e-01, -5.5574e-02,  1.3379e-01,  1.0269e-01,
         1.0452e-01,  2.3986e-02,  1.4015e-01, -3.9869e-02,  3.1962e-02,
         1.2046e-01,  1.5372e-02,  7.4532e-02, -1.9316e-01,  6.1752e-02,
        -7.3845e-02, -2.5231e-02,  1.5001e-01,  1.4532e-01, -8.4633e-01,
         8.7073e-02,  1.0819e-01,  3.5081e-02,  8.5053e-02, -1.2216e-01,
         1.2835e-01,  1.5607e-01, -3.7588e-02,  8.0178e-02,  1.6453e-01,
         1.2252e-01, -6.7541e-04,  8.2943e-02, -3.9198e-02, -1.3526e-01,
         2.6116e-03, -1.3416e-01,  1.7637e-01,  8.7944e-02,  7.6524e-03,
         9.9815e-02,  6.9478e-02,  1.0368e-01, -2.8779e-03,  2.0655e-01,
         5.8613e-02,  7.4368e-02,  8.9972e-02, -2.7691e-02, -4.9731e-02,
        -6.9135e-02,  1.0868e-01,  2.6244e-02, -2.0210e-01,  4.7362e-02,
         1.2374e-01, -5.4774e-03, -4.0313e-03, -3.0035e-02,  1.4077e-01,
         1.2356e-01,  3.7340e-03,  2.6445e-01,  1.4917e-01,  7.8222e-02,
        -4.3484e-01,  2.8827e-02,  5.4760e-02, -1.2365e-01, -3.0351e-01,
         1.1207e-01,  7.1388e-02,  2.5808e-03,  9.7687e-02, -2.0770e-02,
         7.6921e-02,  4.8066e-02, -3.5002e-02,  1.5971e-01,  6.8491e-02,
         7.3245e-02,  7.8202e-02,  2.5484e-02,  1.3691e-01, -9.7701e-03,
         1.0845e-01, -7.6161e-02,  7.7191e-04,  2.0376e-01, -9.9493e-02,
        -9.3491e-02,  9.5678e-02, -6.8717e-03, -1.0968e-01,  8.6918e-02,
         3.6534e-02,  3.3514e-01,  1.2181e-01,  1.8201e-01, -9.6818e-02,
        -1.1485e-01,  1.2914e-01,  3.2308e-02,  1.1907e-01,  3.4547e-02,
         1.9015e-01,  7.2986e-02,  3.9030e-02, -1.0509e-01, -9.8305e-03,
        -1.5110e-01, -8.9721e-02,  3.7692e-01,  5.7211e-02,  9.9464e-03,
         7.5426e-02,  1.5894e-02, -2.3518e-02,  1.6229e-02,  3.0174e-02,
         1.4174e-01, -4.5873e-02, -3.2519e-02,  2.4360e-02, -5.1694e-02,
         8.0766e-03,  1.4054e-01,  1.4740e-01,  6.7029e-02, -6.3782e-03,
        -7.7158e-02,  6.2079e-02,  1.3730e-01, -3.6573e-01,  2.2208e-01,
         5.3740e-02,  5.2301e-02,  2.0854e-02,  6.2967e-02,  2.2041e-01,
        -4.5890e-02,  1.1650e-01, -6.4502e-02,  1.1856e-01,  1.0317e-01,
         7.3146e-02,  1.6169e-01,  1.0085e-01,  9.5029e-02,  2.3691e-02,
         4.7452e-02,  2.6965e-01,  3.0746e-02,  1.0556e-01,  6.5479e-02,
         2.1520e-01, -2.6398e-01,  5.1941e-02,  4.3374e-02,  3.1432e-02,
         7.8844e-02, -2.1496e-01, -3.1007e-02, -1.8203e-01, -1.3061e-01,
         1.9984e-01,  9.4902e-02,  2.9525e-02,  1.2745e-02,  3.8509e-02,
         6.0238e-02,  1.4807e-01,  1.6040e-01,  6.2494e-02,  1.5621e-01,
         4.2483e-02, -1.8520e-01,  3.6974e-02,  3.2843e-02,  1.5007e-02,
        -1.8008e-01,  1.7907e-01,  1.7162e-01, -1.2326e-02,  1.4968e-01,
         4.9689e-02,  5.9230e-02,  1.1797e-01, -5.8377e-03,  1.4040e-01,
        -3.3696e-01,  9.1060e-02, -1.2818e-02,  1.2552e-01,  1.4421e-01,
         1.2493e-01, -1.3811e-02,  7.9634e-02, -1.8466e-01,  3.5309e-02,
         4.8165e-02,  7.3057e-02,  1.0300e-01,  4.6092e-02,  1.1200e-01,
        -9.1888e-03, -9.3984e-02, -1.1322e-01,  2.1226e-01,  1.0305e-01,
         9.4777e-02,  5.3127e-02,  4.2190e-02,  4.2996e-02, -4.4030e-02,
        -2.5095e-02, -5.5975e-02,  3.9855e-02,  7.2354e-02,  1.4146e-01,
         1.7209e-01,  7.6174e-02,  3.1253e-02,  6.5290e-02, -1.0977e-01,
        -3.1703e-02,  1.1302e-01,  2.8285e-02, -3.3151e-02,  1.7735e-01,
         9.3526e-02,  2.2077e-01, -1.7418e-02, -1.5783e-02,  2.9759e-02,
        -1.0274e-02,  2.8176e-02,  4.1800e-02,  5.3104e-02, -1.4859e-01,
         5.3251e-02,  3.1860e-02,  1.9542e-01,  8.0312e-03,  1.4666e-03,
         1.2945e-01,  1.3534e-01,  1.5359e-01,  9.7278e-02,  8.6149e-02,
        -1.1137e-01, -1.7902e-02,  9.2563e-03,  1.6293e-01,  4.9443e-01,
        -1.4069e-01,  6.1134e-02, -1.2497e-02, -9.6147e-02,  3.1645e-03,
         4.2570e-02, -6.7952e-02, -2.3923e-02,  1.6651e-02,  7.4047e-03,
        -5.4524e-02, -1.7130e-01,  8.0671e-02,  1.7044e-01, -1.6208e-01,
        -2.6633e-02,  7.4453e-02,  2.4709e-01,  2.0264e-01, -1.9671e-02,
         5.0530e-02,  1.5865e-01,  4.0015e-02,  1.7632e-01, -3.7870e-01,
         1.4281e-01,  1.4696e-01,  1.0580e-01,  1.5323e-01,  9.4102e-02,
         1.1278e-01, -1.3008e-01,  1.1962e-02, -1.6751e-01,  1.2249e-01,
        -6.0301e-03,  3.4401e-02,  5.5904e-03,  1.4562e-01,  8.8877e-02,
         1.3026e-01,  1.0785e-02, -4.0565e-02, -1.9766e-02, -2.1336e-01,
         5.8849e-03,  1.4757e-01,  1.2280e-03,  7.3065e-02,  1.3179e-02,
         1.5285e-01,  1.0500e-01,  1.3456e-01,  3.6927e-02,  1.2596e-01,
         1.6769e-01, -2.0959e-03])), ('features.21.weight', tensor([[[[-3.4618e-02, -3.3801e-02, -2.2497e-02],
          [-3.2275e-02, -2.8543e-02, -1.5026e-02],
          [-3.1307e-02, -1.8263e-02, -1.1662e-02]],

         [[-6.7787e-03, -5.1631e-03, -1.1498e-02],
          [-3.1353e-03, -9.5856e-03, -1.1940e-02],
          [-1.6923e-02, -1.5893e-02, -9.2058e-03]],

         [[ 2.1721e-02,  1.6138e-03, -1.2762e-02],
          [ 1.1541e-02,  3.9117e-03, -1.7966e-02],
          [ 8.2566e-03, -7.2988e-03, -1.8711e-02]],

         ...,

         [[ 1.1666e-02,  5.8356e-03,  5.1317e-03],
          [ 2.7172e-02,  3.0096e-02,  2.2107e-02],
          [ 5.0745e-02,  5.0426e-02,  5.2568e-02]],

         [[ 1.5641e-02,  6.1531e-03,  1.0435e-02],
          [-4.9628e-03, -1.0472e-02, -9.7399e-03],
          [-1.3043e-02, -1.1895e-02, -8.3080e-03]],

         [[-7.5200e-03, -8.6918e-03, -7.7642e-03],
          [-2.1090e-02, -1.2527e-02, -1.4423e-02],
          [-1.5833e-02, -1.0271e-02, -6.5119e-03]]],


        [[[ 2.9262e-02,  2.4535e-02,  9.8333e-03],
          [ 1.3875e-02,  1.1888e-02,  1.5868e-03],
          [ 3.2187e-02,  2.7896e-02,  2.1428e-02]],

         [[-1.2907e-02, -1.6465e-02, -1.0769e-02],
          [-1.2730e-02, -8.0963e-04, -9.7610e-03],
          [-1.7824e-02, -1.9745e-03, -6.0412e-03]],

         [[ 7.3908e-03,  1.3782e-03, -2.7653e-03],
          [ 2.2362e-02,  3.1297e-03,  7.8103e-03],
          [-3.6186e-03,  4.7948e-03, -3.9560e-03]],

         ...,

         [[ 5.8102e-03,  6.1981e-04, -9.2120e-04],
          [-2.2606e-03, -2.2002e-02, -3.1097e-03],
          [-9.4541e-03, -2.8003e-02, -2.2712e-02]],

         [[ 2.0525e-03, -3.4167e-03,  1.0797e-02],
          [ 8.3235e-03, -7.1854e-03,  8.9610e-03],
          [ 1.1586e-02, -4.0099e-03,  1.9634e-02]],

         [[ 7.4921e-03, -1.0478e-03,  1.5801e-02],
          [ 7.9514e-04, -1.6881e-02, -2.4732e-04],
          [ 1.5973e-02,  1.6192e-02,  3.7039e-03]]],


        [[[-2.3103e-02, -2.4085e-02, -2.1704e-02],
          [ 1.0276e-02, -7.1129e-03,  6.8848e-03],
          [ 8.5694e-03, -1.9288e-03, -2.8843e-03]],

         [[-1.3841e-02, -1.0492e-02, -2.4102e-02],
          [-2.7612e-02, -2.5791e-02, -1.2960e-02],
          [-1.5598e-03,  3.6200e-04,  2.1741e-02]],

         [[ 2.7855e-02,  2.6277e-02,  2.2290e-02],
          [ 2.4780e-02,  2.5150e-02,  2.5566e-03],
          [-1.9022e-03,  1.0823e-02, -8.6423e-03]],

         ...,

         [[-6.3089e-03,  1.8908e-03,  6.9918e-03],
          [-6.9307e-03, -8.7947e-03, -7.2253e-03],
          [-3.5385e-03, -4.9549e-03, -8.7845e-03]],

         [[ 8.2309e-03,  1.8546e-04, -9.4308e-04],
          [ 2.4796e-04, -1.3734e-03, -6.4844e-03],
          [ 1.0330e-02, -6.3096e-03,  2.9899e-03]],

         [[-3.2615e-03,  1.1206e-03,  2.0341e-03],
          [ 3.0882e-03, -1.5877e-02, -3.2855e-03],
          [-1.0955e-02, -5.5521e-03, -1.2025e-04]]],


        ...,


        [[[-1.7462e-02, -3.8714e-02, -3.6843e-02],
          [-2.3918e-02, -3.9357e-02, -2.3753e-02],
          [-6.3624e-03, -1.7850e-02,  1.0370e-03]],

         [[ 2.8356e-02,  1.4364e-02,  8.2898e-03],
          [ 1.7873e-02, -1.1615e-03,  5.5851e-03],
          [-1.2643e-03, -8.9554e-03, -3.0568e-03]],

         [[ 5.1422e-03,  4.6503e-04,  9.0143e-03],
          [ 1.9823e-02,  3.4737e-02,  2.8242e-02],
          [ 3.2088e-02,  2.3840e-02,  2.2072e-02]],

         ...,

         [[ 3.4983e-03,  9.9425e-03,  4.5399e-03],
          [ 1.1027e-02,  4.5929e-03,  2.6449e-03],
          [ 1.7532e-02, -1.0313e-03, -8.3937e-03]],

         [[-1.0549e-02, -1.0171e-02, -5.7416e-03],
          [-8.2740e-03, -8.3159e-03, -1.4377e-02],
          [-1.1800e-02, -1.1000e-02, -1.6324e-03]],

         [[-1.3096e-02, -3.1618e-02, -2.5536e-02],
          [-4.8419e-03, -1.3772e-02, -1.3568e-02],
          [-1.5098e-02, -8.9054e-03, -1.2804e-02]]],


        [[[ 3.8384e-03, -6.2667e-03, -1.1664e-02],
          [ 3.3901e-03, -1.1676e-02, -6.1101e-03],
          [-1.7972e-02, -3.3468e-02, -9.4137e-03]],

         [[ 1.0985e-03,  1.3939e-04,  5.5219e-03],
          [-9.3755e-03, -3.6006e-03, -3.1602e-05],
          [-2.7297e-03, -5.7176e-03, -3.4485e-03]],

         [[ 1.9236e-02,  1.2842e-02,  8.1627e-03],
          [ 1.5062e-02,  4.3942e-04,  1.0795e-03],
          [ 6.7360e-03,  9.0229e-03,  2.8575e-03]],

         ...,

         [[-7.0815e-03, -4.9577e-03,  1.6272e-03],
          [ 2.0418e-03, -8.2440e-03,  8.4400e-03],
          [ 6.3961e-03, -5.5046e-03,  1.0984e-03]],

         [[ 9.5378e-04, -1.1439e-02, -3.1516e-03],
          [ 1.0669e-03, -1.8538e-02, -1.2831e-02],
          [ 5.5736e-03, -1.1039e-02, -1.3992e-02]],

         [[-1.9465e-02, -1.2852e-02, -1.8318e-02],
          [-2.6698e-02, -1.8011e-02, -1.0662e-02],
          [-1.6479e-02, -1.4482e-02, -1.6194e-02]]],


        [[[-2.3728e-02, -3.6695e-02, -3.7500e-02],
          [-1.3462e-03, -3.9573e-04,  3.2643e-03],
          [ 1.5174e-02,  2.6909e-02,  1.3840e-02]],

         [[ 2.8536e-04, -1.5611e-02, -6.2689e-03],
          [-4.9708e-04, -2.2292e-02, -2.0291e-02],
          [ 1.2825e-02, -1.6755e-02, -2.1885e-02]],

         [[ 8.5642e-03,  6.9444e-03,  9.6820e-03],
          [ 3.2590e-03,  1.7821e-02,  7.3303e-03],
          [ 1.2386e-02,  2.1082e-02, -7.5897e-03]],

         ...,

         [[ 7.6673e-03,  1.3758e-02,  1.1945e-02],
          [ 8.6567e-03,  1.0310e-02, -1.6190e-03],
          [ 1.7062e-02, -6.1529e-03, -4.0647e-03]],

         [[ 1.5687e-02,  3.6550e-03, -1.1310e-02],
          [-1.4527e-04,  8.9713e-04,  2.0525e-03],
          [-1.0805e-02, -5.5566e-03,  8.8173e-03]],

         [[-1.4262e-02, -1.7638e-02, -6.3932e-03],
          [-2.4702e-03, -1.2362e-02, -2.2834e-02],
          [-4.4622e-03, -9.5870e-03, -1.7204e-02]]]])), ('features.21.bias', tensor([ 5.3096e-02,  1.0494e-02,  2.3031e-01,  3.7629e-02,  8.6362e-02,
        -5.3445e-02,  1.3858e-01, -7.1123e-02, -4.1582e-02, -6.0357e-02,
         2.8702e-02,  3.9870e-02,  2.4511e-02, -2.9192e-02,  2.2518e-02,
         1.5705e-01,  1.5073e-01, -3.4747e-02, -2.9308e-02,  1.6866e-01,
        -7.8936e-02,  1.5662e-01,  6.9270e-02,  2.1940e-01,  8.5960e-03,
         4.4231e-02,  5.8154e-03,  3.2049e-01,  2.1366e-01,  2.0677e-02,
        -2.1056e-01,  2.3449e-01, -4.8404e-04,  1.2819e-01,  2.7670e-02,
         1.3770e-02, -8.2480e-02,  1.1657e-01,  1.3776e-03, -6.9343e-02,
        -4.2484e-02, -4.8676e-02,  1.5156e-01,  4.5194e-02,  9.5455e-02,
         9.9230e-02, -4.9602e-02,  1.0385e-01, -1.9058e-01, -6.8478e-03,
         1.2834e-01, -1.5414e-01, -8.2917e-02,  1.2840e-01,  1.0515e-01,
        -3.4903e-03, -2.4074e-02,  2.7386e-01,  8.2506e-02,  2.6081e-02,
         1.0385e-01,  1.2873e-01,  1.1904e-02,  3.2242e-01,  7.7528e-02,
         1.5680e-01, -9.4496e-02,  6.5867e-02,  1.1608e-01,  2.9928e-02,
         4.5040e-02,  6.6757e-02, -3.8690e-03,  4.5608e-02, -6.0798e-02,
        -7.9031e-02,  1.8973e-01,  9.7177e-02,  2.8907e-02,  5.2512e-02,
         8.9481e-02, -1.0245e-02, -3.3247e-02,  3.2455e-02,  1.7449e-01,
         5.4149e-02,  3.5487e-02, -6.0035e-02,  1.0988e-01,  4.1636e-02,
         1.0168e-01, -1.3880e-02, -2.2165e-02, -2.3697e-02, -2.0682e-02,
        -7.4109e-02,  7.1141e-02,  2.8931e-01,  5.7430e-02,  2.6998e-01,
         1.3690e-01,  1.2856e-01,  9.7829e-02, -3.3965e-02, -6.0774e-01,
         1.3285e-01,  7.6127e-02,  1.8083e-03,  3.7983e-02,  3.1329e-02,
         2.3151e-01,  1.7247e-01,  7.9159e-02,  2.0701e-02,  4.6385e-02,
         1.1695e-02,  1.7603e-01,  8.7159e-03,  1.4734e-01, -1.6980e-01,
         5.8873e-02,  4.5943e-03, -2.5116e-02, -1.0081e-02,  1.7245e-01,
         5.0457e-02,  3.1419e-03,  1.9542e-01,  2.3010e-01,  1.4896e-02,
         6.8453e-03,  6.4402e-02,  2.8297e-01, -1.9778e-02, -6.6403e-02,
        -1.7974e-01,  1.1520e-01,  1.8115e-01,  6.7828e-02,  1.4529e-01,
         9.5749e-02, -4.8107e-02,  1.7572e-01,  2.0596e-02,  2.0453e-01,
         1.0453e-01,  2.7929e-03, -6.7208e-02,  1.1605e-01,  3.2382e-01,
        -2.5631e-02, -1.0080e-01, -2.7476e-01, -4.3790e-02,  1.0209e-01,
        -4.0674e-02,  1.4236e-01,  4.9621e-02,  1.3615e-02, -6.8988e-02,
        -1.5604e-01, -5.6830e-02,  2.1956e-01, -3.9003e-02,  7.6721e-02,
         1.7829e-01,  3.5841e-02, -1.6543e-01,  1.0653e-01,  1.2691e-01,
         8.0850e-02,  3.5409e-02,  7.6336e-02,  1.8354e-01, -3.1974e-02,
         1.0952e-01, -7.7806e-02, -1.8276e-02,  1.9917e-03, -5.3514e-02,
         6.8031e-02,  1.3051e-01,  5.5512e-02, -2.2692e-01, -1.7514e-01,
        -2.3241e-02, -8.0095e-02,  2.4215e-01, -9.3736e-02, -2.7950e-02,
        -4.0031e-02, -8.9803e-04, -1.3281e-01,  1.6617e-02, -1.7896e-01,
         2.2928e-03,  7.4135e-02,  7.4704e-02, -5.3855e-02,  3.5239e-03,
         6.8048e-02, -1.7627e-02, -7.6305e-02, -3.0225e-02, -1.9956e-02,
         7.6958e-02,  6.6637e-02,  7.5784e-02,  2.0265e-01,  8.2736e-02,
         1.8189e-01,  1.5864e-01, -2.7969e-02,  1.2254e-01,  1.6273e-01,
         7.0590e-02,  3.6348e-02,  7.5238e-02,  4.0113e-02,  1.7456e-01,
         1.3055e-01, -2.3147e-01, -4.0592e-02, -9.2117e-02,  4.7834e-02,
         5.8923e-02, -4.9228e-02,  2.3561e-01,  5.6799e-02,  2.6177e-03,
         1.8197e-01,  2.4430e-01,  1.5937e-01,  1.2356e-01,  2.0870e-02,
         2.2301e-01, -8.7270e-02,  2.1521e-03,  5.6075e-02,  5.3088e-02,
         2.5135e-01, -2.5713e-02, -5.7987e-02,  1.2134e-01, -6.9332e-02,
         1.7102e-01,  8.0538e-02, -2.1009e-02,  1.5748e-01,  1.3500e-01,
         3.5484e-02,  1.9533e-02, -1.0588e-01, -1.1630e-02,  7.3210e-02,
         6.1526e-02,  9.7647e-02,  1.2334e-01,  7.9605e-02, -1.5892e-02,
         8.3292e-02,  1.1110e-01,  5.2385e-02,  1.5979e-01,  4.5474e-02,
         1.3827e-01,  2.3116e-02, -1.3866e-01,  3.0925e-02, -1.9310e-02,
         1.0778e-02,  2.7404e-02,  1.5212e-01, -2.1072e-02,  2.2597e-01,
        -2.4462e-03, -4.5231e-02, -5.3727e-02,  6.5086e-02, -8.8079e-02,
        -6.8959e-02,  1.5689e-01,  3.5168e-02,  1.4016e-02,  7.8228e-02,
        -7.1301e-03,  7.0884e-02, -2.0291e-02, -4.3556e-02,  8.2587e-02,
         1.0355e-01,  2.4044e-01,  1.5205e-03,  1.3740e-01,  1.0288e-01,
         4.9636e-02,  6.0422e-02,  2.2115e-02,  4.1499e-02,  1.7964e-01,
         8.9835e-02,  6.3780e-02,  4.4028e-02,  2.5870e-02,  2.6749e-01,
        -8.6992e-02,  4.2132e-02,  4.5251e-02, -6.7016e-03,  1.2589e-01,
         1.0735e-01,  1.4337e-02,  5.1316e-02,  3.7713e-03,  1.1460e-02,
        -1.4947e-02, -1.3711e-02,  1.4697e-01,  9.2782e-02,  1.2916e-01,
         1.7470e-01,  5.8596e-02,  1.1636e-01,  5.8924e-02, -1.4533e-01,
         1.6085e-02,  5.6891e-02, -4.3371e-02,  2.0790e-02, -3.9939e-02,
         4.3089e-04,  1.6872e-01,  1.7437e-01,  1.1686e-01, -1.2212e-03,
         6.0886e-04,  1.0210e-01, -2.6895e-02, -1.5379e-01,  1.8642e-02,
         1.4519e-01,  1.3723e-01,  1.6059e-01,  1.0188e-01,  1.5790e-01,
         5.3370e-02, -9.6922e-03,  1.0662e-01, -3.2237e-02,  1.6459e-01,
        -3.2802e-02,  9.4145e-02,  1.6049e-01,  3.3623e-02,  8.2616e-02,
         1.2163e-02,  1.8475e-01, -1.5923e-01,  1.1078e-01,  4.3297e-02,
         9.3649e-02, -5.2736e-03,  1.5716e-01,  1.7663e-01,  1.5766e-01,
        -6.5356e-02,  4.1497e-02,  5.5715e-02, -5.0333e-02,  4.9138e-02,
         5.1402e-02,  9.5557e-02,  2.9288e-02,  7.0810e-02,  2.3480e-01,
         1.3228e-01, -2.3599e-02, -1.2055e-01,  2.6201e-02,  4.7531e-02,
        -2.3009e-02,  1.6585e-02,  7.9533e-02,  3.5151e-01,  2.1487e-01,
         3.2147e-02,  1.9151e-02,  2.6160e-01,  6.0619e-02, -2.7466e-02,
         3.8685e-01,  2.6087e-01, -1.6858e-02,  3.9768e-02, -1.1643e-01,
        -1.1088e-01, -2.6395e-01, -5.5512e-02,  2.3809e-01,  4.1467e-02,
        -6.7768e-02,  7.4545e-02,  1.6406e-01,  4.1792e-02,  1.4026e-02,
        -8.9575e-02,  4.0771e-02, -6.3659e-03,  1.6554e-01,  3.2879e-02,
        -1.0687e-01,  2.1432e-01, -5.3219e-04, -4.8029e-02,  1.5006e-01,
         2.5357e-02, -6.6046e-02, -3.5784e-03, -1.5199e-02, -1.5227e-01,
         2.6880e-01,  1.4434e-01,  8.7642e-02,  1.4905e-01,  4.5407e-02,
         6.8893e-02,  6.4361e-02,  3.1035e-01,  4.9365e-02, -9.4566e-03,
        -1.7363e-02, -1.0042e-01,  8.5943e-02,  2.1078e-02, -5.3363e-02,
        -2.8033e-02, -3.2484e-02,  8.7631e-03,  5.7897e-02,  6.6533e-02,
         5.5471e-03,  1.6292e-01,  1.7233e-03,  3.3627e-01, -4.0299e-02,
         4.1980e-02,  1.7569e-01,  6.0349e-03,  6.1534e-02,  1.0451e-02,
         1.3474e-02,  6.5710e-02,  7.1867e-02,  4.9509e-02,  3.0298e-01,
        -4.8346e-02,  1.5135e-01,  1.0070e-01,  2.2932e-02,  2.6473e-01,
         9.3903e-02,  6.8277e-02,  2.1148e-01,  3.4836e-02,  1.9828e-01,
         9.3527e-02,  4.0988e-02,  2.0483e-01,  2.4628e-02, -1.5936e-02,
        -7.9222e-02,  1.7063e-02,  7.0228e-02,  5.1478e-02,  2.8280e-02,
        -3.8762e-03, -1.0082e-01,  1.3170e-01,  1.7213e-01,  1.2682e-01,
         1.2299e-01,  9.6196e-02,  1.4434e-01, -2.9454e-02,  1.2433e-01,
        -1.8897e-01,  4.4738e-03,  6.6992e-02, -4.8120e-02,  6.5972e-02,
        -1.9316e-01,  2.2723e-01,  5.6969e-02,  5.1578e-02,  6.0070e-02,
         6.1307e-02,  1.0806e-01,  3.7007e-02,  8.3496e-02,  2.3447e-02,
         4.9168e-02,  1.5781e-02,  1.1263e-02,  1.8551e-01,  1.1121e-01,
         9.0919e-03, -1.7644e-02,  1.5611e-01, -3.9080e-02,  1.2658e-02,
        -5.5652e-02,  8.2594e-02])), ('features.24.weight', tensor([[[[-2.9665e-02, -1.8004e-02, -2.0759e-02],
          [-2.3392e-02, -8.0310e-03, -1.2426e-02],
          [-1.7737e-02, -1.7743e-02, -2.7021e-02]],

         [[-2.1687e-02, -2.5525e-02, -6.7156e-03],
          [-1.3061e-02, -1.7542e-02, -1.5949e-02],
          [-2.4782e-02, -1.0104e-02, -4.9635e-03]],

         [[-4.2964e-03, -3.6401e-03, -6.3512e-03],
          [ 1.0383e-02,  2.3713e-02,  1.4648e-02],
          [-9.3529e-03, -1.2316e-03, -8.4364e-03]],

         ...,

         [[ 2.5568e-02,  3.8466e-02,  2.1158e-02],
          [ 4.5726e-02,  5.0937e-02,  3.1546e-02],
          [ 3.8903e-02,  4.3654e-02,  3.7143e-02]],

         [[ 2.6901e-02,  1.0798e-02,  1.9648e-02],
          [ 2.8889e-03, -8.7730e-03,  1.4934e-02],
          [ 4.2627e-03, -8.3357e-03,  2.3783e-02]],

         [[ 1.5674e-02,  1.1260e-02,  1.9177e-02],
          [ 2.7215e-02,  9.9037e-03,  2.5009e-02],
          [ 9.9336e-03,  7.7196e-03, -1.3929e-03]]],


        [[[-2.3820e-02, -2.3844e-02, -3.2966e-04],
          [-1.2515e-02, -1.1827e-02,  2.5957e-03],
          [ 5.6352e-04, -4.4090e-03,  9.8300e-03]],

         [[ 9.0568e-03,  9.2629e-03,  1.4934e-02],
          [ 2.8985e-03,  1.8503e-02,  1.6307e-02],
          [-1.4100e-02,  2.3823e-03, -1.1177e-02]],

         [[-1.1710e-02, -1.2035e-02, -9.6249e-03],
          [ 3.7106e-03,  1.3383e-02,  1.1210e-02],
          [ 2.5377e-04,  9.5491e-04,  2.6870e-03]],

         ...,

         [[-1.3927e-03, -3.7516e-04,  3.2514e-03],
          [ 2.4906e-02,  2.3891e-02,  1.4050e-03],
          [ 2.8756e-02,  2.8597e-02,  6.6499e-03]],

         [[-5.6646e-03,  1.5783e-02,  4.7909e-03],
          [-1.4084e-02,  8.0757e-03, -2.0989e-03],
          [-6.8815e-03, -1.7941e-03, -1.1487e-02]],

         [[ 3.2968e-02,  5.8415e-02,  8.3329e-03],
          [ 1.0411e-02,  3.5860e-02,  8.3363e-03],
          [-1.5696e-02, -1.5042e-02,  1.7315e-03]]],


        [[[ 2.1141e-02,  1.5798e-02,  1.6444e-02],
          [ 1.4905e-02,  6.3904e-03,  2.6291e-03],
          [ 3.3458e-02,  1.3344e-02,  1.3005e-02]],

         [[ 1.1242e-02,  8.7495e-03,  2.7007e-03],
          [ 2.2816e-02,  1.4478e-02,  4.8603e-03],
          [-3.7791e-04, -4.8188e-03, -1.1555e-02]],

         [[-2.8469e-02, -2.9225e-02, -3.5925e-02],
          [-2.3655e-02, -1.7323e-02, -2.4310e-02],
          [-2.7181e-02, -2.8016e-02, -2.4610e-02]],

         ...,

         [[-9.0945e-03, -1.1648e-02, -1.8368e-03],
          [-9.1741e-03, -1.1730e-02, -5.2244e-03],
          [-3.2614e-04, -3.2733e-03, -1.5314e-02]],

         [[-5.3404e-03,  3.1406e-03, -4.0876e-03],
          [-1.8448e-02, -1.4205e-02, -8.0051e-03],
          [-4.1017e-02, -1.7671e-02, -1.6075e-02]],

         [[-5.0619e-03, -3.8657e-02, -1.6724e-02],
          [ 7.7710e-03, -4.6123e-02, -3.3794e-02],
          [ 3.0187e-02, -4.1111e-03,  4.1263e-03]]],


        ...,


        [[[-8.4440e-03,  1.4478e-02,  2.0925e-03],
          [-1.8277e-02,  9.9649e-03, -9.6685e-03],
          [-2.7329e-02, -9.8696e-04, -7.9309e-03]],

         [[ 2.2844e-02,  3.1802e-03,  1.7223e-02],
          [ 7.9945e-03, -1.7438e-02, -1.8138e-02],
          [ 5.6933e-03, -1.1354e-02,  3.0347e-03]],

         [[-8.3175e-03, -3.1811e-02, -2.2094e-02],
          [ 1.4638e-05, -1.5316e-02, -1.5267e-02],
          [-7.2670e-03, -8.0666e-03, -5.5703e-03]],

         ...,

         [[ 1.2208e-03, -4.1981e-03,  2.4875e-03],
          [ 1.2551e-02,  3.9157e-03,  3.4247e-03],
          [ 9.6486e-03,  1.4965e-02,  7.2044e-03]],

         [[-2.3419e-02, -2.4347e-02, -1.6248e-02],
          [-1.9058e-02, -2.2891e-02, -1.8188e-02],
          [-6.6299e-03, -2.0042e-02, -1.3563e-02]],

         [[-1.7024e-02, -2.0971e-02, -3.7842e-02],
          [-5.2446e-03, -2.0623e-02, -2.7047e-02],
          [ 1.4369e-02, -1.0064e-02,  7.1109e-03]]],


        [[[ 8.4927e-03,  2.8716e-02,  1.7452e-02],
          [ 1.3738e-02,  1.8917e-02,  5.4851e-03],
          [ 1.4782e-02,  1.0775e-02, -2.3456e-03]],

         [[ 8.8791e-03,  1.1923e-02,  2.7322e-02],
          [ 2.5228e-02,  2.2188e-02,  3.0305e-02],
          [ 3.5736e-02,  2.4427e-02,  2.1815e-02]],

         [[-5.7071e-03, -8.7913e-03, -1.3530e-02],
          [-5.4085e-03, -1.7407e-03,  2.3131e-03],
          [ 8.3093e-03,  4.2748e-03,  1.2303e-02]],

         ...,

         [[ 5.5613e-03,  1.1008e-02, -7.1487e-04],
          [ 1.0556e-02,  2.2342e-02, -1.0048e-03],
          [-7.6637e-03,  1.4437e-03, -8.7726e-03]],

         [[-1.4743e-02, -3.4066e-02, -2.0108e-02],
          [-5.4339e-03, -1.9609e-02, -1.5343e-02],
          [-5.1284e-03, -1.1401e-02,  1.2394e-04]],

         [[-1.6594e-02, -3.8284e-02, -7.5498e-03],
          [-1.3931e-02, -1.7271e-02, -8.3798e-03],
          [ 2.1377e-03, -2.7655e-03, -2.0783e-02]]],


        [[[ 9.3254e-03,  9.9774e-03,  1.4181e-02],
          [ 1.7003e-02,  1.4496e-02,  1.8798e-02],
          [ 3.4987e-02,  3.2703e-02,  4.6225e-02]],

         [[-5.5553e-03,  1.6191e-03, -8.5051e-03],
          [-1.4465e-02, -7.8599e-05,  5.5291e-04],
          [-3.7181e-02, -3.0638e-02, -2.9953e-02]],

         [[ 4.4973e-02,  2.9909e-02,  3.9455e-02],
          [ 4.1707e-02,  2.9728e-02,  3.0226e-02],
          [ 3.2294e-02,  3.8331e-02,  5.5640e-02]],

         ...,

         [[-5.5318e-03, -2.5768e-03, -1.9835e-02],
          [-3.8708e-03, -6.0238e-03, -5.2313e-03],
          [ 5.3449e-03,  1.9162e-02,  1.5444e-02]],

         [[-4.0897e-03, -2.1466e-02, -3.2437e-02],
          [-4.8543e-03, -8.3130e-03, -1.7764e-02],
          [-4.6017e-03, -1.2160e-02, -1.6609e-02]],

         [[-1.7130e-02, -1.9588e-02, -9.0539e-03],
          [-1.5584e-02, -2.0674e-03, -1.0101e-02],
          [ 6.5303e-03,  3.2189e-03,  8.5852e-04]]]])), ('features.24.bias', tensor([ 1.6997e-02, -8.7523e-02, -3.9945e-02,  1.1659e-01,  7.1463e-03,
        -8.6225e-03,  3.5613e-03,  4.1200e-02,  7.9841e-02,  9.5307e-02,
         7.8111e-02,  3.9813e-02,  6.8257e-02, -5.2504e-02,  4.3717e-01,
         1.4831e-01,  3.0033e-02,  2.2733e-01,  9.5732e-02,  7.6517e-03,
         9.7672e-02, -1.1207e-01,  1.8533e-02, -1.2867e-01, -5.7986e-02,
         1.4702e-01, -1.0547e-02, -1.6095e-01,  1.2300e-01, -1.7012e-01,
         1.2401e-01, -7.5310e-02,  3.1701e-02,  1.7607e-01, -1.7784e-01,
         1.0113e-01, -2.4998e-01, -1.3779e-01,  5.3955e-02, -1.2948e-01,
         4.8545e-03,  7.3792e-02, -1.4859e-01,  9.5392e-02, -2.4602e-02,
         8.3897e-02, -6.5401e-02, -9.7681e-02,  4.4745e-02, -1.3100e-01,
         4.8532e-02,  3.8608e-02,  1.3137e-01,  3.8055e-02,  4.1357e-02,
         5.1061e-02, -4.0593e-02,  2.3771e-01, -5.6327e-02,  1.6970e-01,
         3.0759e-02, -9.6201e-02, -6.4206e-02, -1.0849e-01,  2.6529e-02,
        -2.1004e-01,  1.0225e-01, -7.0348e-02, -1.2984e-01,  7.1541e-02,
        -7.2142e-02, -5.5398e-03,  1.7476e-01,  5.4846e-02,  2.1085e-01,
        -5.7996e-02,  8.2948e-02,  2.7528e-01, -1.1895e-01,  4.2671e-02,
         1.1413e-02,  9.5554e-03,  2.7650e-02,  8.3081e-02,  1.6358e-01,
         1.5594e-01, -3.7932e-02, -9.6472e-03,  9.2585e-02, -4.8008e-02,
         8.2199e-02, -3.2398e-01,  1.3381e-01,  1.1170e-01, -1.5708e-01,
        -1.2178e-01,  7.3881e-02,  1.2439e-01, -1.1057e-01, -6.7567e-02,
         1.3011e-01, -2.2576e-02,  4.3847e-02, -3.3202e-01, -9.6008e-02,
        -1.5401e-02, -1.4233e-01,  1.7160e-01, -8.8213e-02,  2.2654e-02,
        -1.2759e-02,  5.1638e-02,  4.1167e-02, -8.5116e-02, -1.7608e-02,
         7.5914e-02, -1.1214e-03,  2.1244e-01,  2.1548e-02,  1.3191e-01,
         1.0271e-02,  7.8493e-02,  1.5120e-01, -7.0706e-03, -4.5366e-02,
        -6.8868e-02,  1.8619e-01, -1.5458e-02, -1.9538e-03,  5.6696e-02,
         4.0297e-01, -1.1122e-01,  3.7485e-02,  1.2393e-01,  2.6619e-01,
        -6.0331e-03,  4.3961e-02,  1.6793e-01, -4.6771e-02, -3.8935e-02,
        -5.1440e-02, -9.7461e-02, -9.1474e-02,  1.2764e-01,  8.3977e-02,
         7.4843e-02,  1.4122e-01, -2.8847e-02,  3.3013e-02,  1.4290e-01,
         1.2551e-01,  1.5431e-02, -8.2567e-02, -4.7961e-02, -5.5157e-02,
        -2.3662e-02, -1.2304e-02, -1.6172e-02, -1.3185e-01, -3.2622e-02,
         8.5980e-03, -1.3255e-01,  4.9817e-02, -5.2902e-02,  3.7457e-02,
        -2.0201e-01,  6.6079e-02,  2.7192e-02,  1.5407e-01,  1.0915e-01,
        -2.1090e-01,  1.8848e-01,  2.1473e-01,  1.8386e-02,  1.0403e-01,
         5.9797e-03,  1.2258e-02, -1.5531e-02, -1.2297e-01,  1.2950e-01,
         1.7972e-01,  1.2616e-01,  9.6519e-02,  9.9225e-02, -3.7133e-02,
        -1.1575e-01,  1.5435e-02, -5.3834e-02,  1.0502e-01, -2.0073e-02,
         2.0620e-02, -1.9642e-02,  1.3522e-01,  4.4568e-02, -7.3237e-02,
        -1.2374e-01, -3.1722e-02, -3.6039e-02,  3.0060e-02,  6.1620e-02,
         3.3718e-02, -1.5714e-02, -3.4826e-02, -6.0854e-02,  8.3800e-02,
         1.8769e-02,  1.5213e-01,  8.5224e-02,  7.5792e-02,  1.0706e-01,
        -4.2495e-01,  1.1640e-01, -2.2343e-01,  1.1909e-01, -1.2814e-01,
         8.9582e-03,  7.0755e-02, -2.2811e-01,  9.8118e-02, -1.3672e-01,
         1.8078e-01,  5.5584e-02,  1.8741e-01,  2.5445e-02,  1.0880e-01,
        -5.3879e-02,  1.8954e-03,  5.9263e-03,  2.0566e-01,  3.9427e-02,
         1.5812e-01,  1.8293e-02,  2.8056e-01,  1.1011e-01,  1.5504e-01,
         7.5534e-02,  7.3252e-02,  1.6881e-01,  6.6641e-02,  7.8446e-02,
        -1.9303e-02,  1.3514e-01,  3.8848e-02, -7.8715e-02, -2.4682e-02,
         9.8971e-02,  4.4270e-02, -5.8034e-02,  1.8438e-02, -8.4324e-02,
        -7.2090e-02,  1.8305e-01,  9.3458e-02,  5.7189e-02,  6.8233e-02,
         6.3328e-02,  7.2164e-02,  1.5698e-02,  9.2628e-02,  3.3019e-02,
         3.2265e-03,  8.8894e-02, -1.3000e-01,  2.7636e-03,  5.7695e-02,
        -3.6553e-02, -1.1188e-02,  1.6168e-01,  2.4410e-01,  3.2037e-02,
        -3.2630e-02,  4.1609e-02,  1.6842e-01,  9.4469e-02, -1.3733e-01,
        -2.3390e-02, -1.3076e-01, -2.7256e-02,  5.3831e-02, -1.4552e-02,
         9.6054e-02,  3.9509e-02,  9.2404e-02,  5.2597e-02,  3.3529e-02,
         2.5394e-03,  9.1736e-02, -1.8199e-01, -4.5320e-02,  5.5710e-02,
         4.9833e-02, -1.6775e-01,  1.2425e-01,  3.6861e-02,  9.7389e-02,
         1.4430e-01,  1.0937e-01, -2.1108e-02,  1.1777e-01,  1.3234e-01,
         1.4809e-01,  4.0667e-02,  3.2418e-03,  1.4640e-02, -2.7107e-01,
         2.4108e-02,  2.8035e-02,  4.6187e-02, -8.8954e-03,  8.0967e-02,
        -1.0782e-01, -2.7225e-01, -2.9722e-02,  1.0527e-01,  8.1967e-02,
        -3.9744e-02, -1.6479e-02,  1.4692e-01, -4.0941e-02,  1.6848e-01,
         1.2172e-03, -3.2054e-02, -2.5082e-02, -5.3606e-02,  6.2650e-02,
        -1.8099e-01, -4.2285e-02, -1.1222e-01, -3.0463e-02, -7.6558e-02,
         1.2961e-01, -6.6143e-02,  1.2919e-01, -2.2140e-01,  7.8037e-02,
         8.3968e-03, -5.4351e-02, -5.6294e-02, -5.7976e-02,  2.6422e-02,
         1.6429e-01,  1.9992e-02, -6.0836e-02,  4.7631e-02,  9.5938e-02,
         9.8480e-02,  1.8134e-01, -1.5124e-01,  4.3854e-03,  1.9267e-01,
        -3.4172e-02, -1.7238e-01,  5.9281e-02,  2.1720e-01,  3.8778e-02,
         3.1199e-02,  3.3372e-02, -7.8134e-02, -1.0782e-01, -7.7580e-02,
        -5.3064e-02, -2.7654e-03,  2.1045e-02, -5.0244e-02, -1.2194e-01,
        -9.0225e-02,  1.6694e-01, -7.0426e-02, -2.5195e-01, -4.0610e-02,
         2.0970e-01,  6.8482e-02, -1.4830e-01,  5.4409e-02, -9.6297e-02,
         7.5046e-02,  4.1459e-02, -1.8434e-02,  5.1478e-02,  3.1844e-02,
         7.9317e-02, -2.4072e-02, -1.9615e-03,  1.0515e-01, -3.3585e-02,
        -9.9882e-02,  1.9406e-01, -1.6366e-01, -1.5509e-01, -9.7908e-02,
         1.4446e-02,  1.1277e-01, -1.0612e-01,  4.6881e-02, -2.9975e-02,
         2.2594e-01, -5.8458e-02, -1.3480e-01,  1.1511e-02,  2.8530e-02,
         1.3362e-01,  4.2482e-02,  3.1533e-02,  1.1483e-01,  1.7400e-02,
        -5.4461e-02,  9.5280e-02,  2.7508e-02, -1.2620e-01,  1.2727e-01,
         2.7821e-02,  8.9579e-02,  9.6470e-03, -1.5670e-01, -9.6572e-02,
        -2.1230e-01,  8.0168e-02,  2.3270e-01,  6.8078e-02, -4.8857e-02,
        -5.6181e-02,  1.1939e-01,  8.5138e-02,  9.6112e-03,  1.5150e-01,
        -2.0642e-01, -5.2131e-02,  1.7484e-01, -4.6232e-02, -1.1997e-01,
         8.2968e-02,  3.6806e-02, -4.7271e-02, -4.3440e-02,  1.4251e-01,
         1.0247e-01, -1.9491e-01,  4.2062e-02, -4.0442e-02,  1.0779e-01,
         1.6921e-01,  5.9144e-02,  2.4255e-01,  4.7628e-02, -3.3757e-02,
         1.4118e-01, -6.5160e-02,  1.2729e-01,  4.3777e-02,  4.9147e-03,
        -3.7822e-02,  8.1458e-02,  1.0107e-01,  9.7378e-02,  1.0344e-01,
        -2.4163e-05,  1.1313e-01, -1.9346e-01,  1.2787e-01,  2.3269e-01,
         2.0879e-02, -2.5601e-02, -3.5052e-02,  1.7041e-01, -2.5763e-02,
         2.3870e-02,  8.5637e-02,  7.6319e-02, -9.1085e-02, -2.7452e-01,
        -1.0142e-01, -1.6270e-01,  1.1200e-01, -2.8779e-02,  1.1195e-01,
        -2.2108e-02, -7.1684e-02,  5.6318e-02,  4.0374e-02, -5.7313e-02,
         5.3727e-02, -4.0019e-02,  1.5735e-01, -7.2448e-02, -2.5735e-02,
        -2.1199e-02,  2.0688e-01,  1.3733e-02, -1.0036e-01,  3.5409e-03,
         6.1670e-02,  4.9499e-02,  2.2640e-03,  1.5324e-01,  1.0493e-01,
         3.2033e-02,  8.2300e-02, -4.6450e-02, -2.3301e-02,  1.4094e-01,
         1.8280e-02,  4.5977e-02,  8.3666e-02,  2.0596e-02,  2.5313e-02,
         8.9128e-02,  1.4856e-01, -2.9706e-01, -7.6075e-02,  8.2314e-03,
         7.8032e-02, -4.7001e-01])), ('features.26.weight', tensor([[[[ 5.3396e-03, -2.6011e-03,  2.0471e-03],
          [-5.5203e-04, -5.6705e-03, -1.6622e-02],
          [-5.3414e-03, -4.3450e-03, -1.1729e-02]],

         [[ 2.8564e-02,  2.7208e-02,  3.0957e-02],
          [ 2.9747e-02,  2.6193e-02,  3.5095e-02],
          [ 2.9610e-02,  4.1583e-02,  3.3541e-02]],

         [[-4.8096e-03,  3.1882e-03,  1.0270e-03],
          [ 6.3651e-03,  1.7796e-02,  1.4464e-02],
          [-2.8096e-03, -5.9703e-03,  2.8339e-03]],

         ...,

         [[ 1.8245e-03,  8.2978e-03, -4.4093e-04],
          [ 3.4736e-04, -7.0685e-03, -1.1561e-02],
          [-8.2451e-03, -2.0998e-02, -1.2935e-02]],

         [[ 1.1445e-02,  1.9142e-02,  1.2391e-02],
          [ 5.1714e-03,  1.4061e-02,  1.2852e-02],
          [-2.2861e-03,  3.0864e-03,  2.8760e-03]],

         [[ 4.0615e-03,  1.2981e-02,  3.9028e-03],
          [ 1.0133e-02,  2.2851e-02,  1.2542e-02],
          [-1.8526e-02,  4.0812e-03, -7.3445e-03]]],


        [[[ 6.6611e-03,  1.6469e-02,  1.8038e-02],
          [ 4.2513e-03,  1.3071e-02,  1.3559e-02],
          [ 5.8119e-05, -5.8924e-03,  2.7461e-03]],

         [[-1.9168e-02, -1.1762e-02, -6.3617e-03],
          [-4.4906e-03,  5.5111e-03,  2.2184e-02],
          [ 1.5402e-02,  3.0761e-02,  2.4692e-02]],

         [[ 2.4585e-02,  1.4311e-03,  1.1614e-02],
          [ 3.0728e-03,  3.2102e-03, -2.3297e-03],
          [ 8.8638e-03,  2.1141e-04, -6.4401e-03]],

         ...,

         [[-1.1725e-03, -1.5327e-02, -9.5785e-03],
          [-3.2860e-03, -1.0098e-02, -9.1001e-03],
          [-8.7265e-03, -1.0286e-02, -1.2795e-02]],

         [[-2.2210e-03, -1.1368e-02, -1.6937e-02],
          [-4.1622e-03, -1.7335e-02, -1.9301e-02],
          [ 1.7208e-02, -5.8893e-03, -3.5251e-03]],

         [[ 4.2934e-04, -3.1749e-02, -1.1264e-02],
          [-1.3598e-02, -2.6306e-02, -1.2232e-02],
          [-1.0754e-02, -6.1461e-03,  1.9349e-03]]],


        [[[-7.4869e-03, -1.0894e-02, -2.3739e-02],
          [ 1.2003e-02, -4.4158e-03, -2.6271e-02],
          [ 1.0297e-02, -1.4211e-02, -2.0285e-02]],

         [[-7.8340e-03, -2.3295e-02, -2.0594e-02],
          [-4.7429e-03, -1.5618e-02, -1.8468e-02],
          [ 2.5025e-03, -1.0162e-02,  2.7711e-03]],

         [[ 8.0493e-03, -1.5987e-02,  4.0480e-03],
          [ 5.0285e-04, -1.5592e-02, -9.4860e-04],
          [ 1.8756e-03, -1.6222e-03,  2.6918e-02]],

         ...,

         [[-6.0127e-03, -4.9466e-03,  9.5168e-03],
          [-5.3006e-03, -7.0202e-03,  6.6488e-03],
          [ 2.5722e-03, -5.2046e-03,  7.1014e-04]],

         [[-2.1340e-02, -1.3918e-02, -1.2257e-02],
          [-1.9682e-02, -2.2466e-02, -1.6505e-02],
          [ 1.6370e-03, -1.8450e-03, -1.6151e-02]],

         [[-6.9218e-03, -9.6376e-03, -6.8654e-03],
          [-2.6699e-02, -8.4984e-03, -1.5467e-02],
          [-2.1957e-02, -3.2741e-03, -1.0307e-02]]],


        ...,


        [[[-9.1366e-03, -6.9445e-03, -1.6918e-03],
          [-1.4680e-02, -7.3195e-03, -1.8997e-03],
          [-1.7819e-02, -6.0907e-03, -3.8606e-03]],

         [[-2.6625e-03, -4.5790e-03, -5.2848e-03],
          [ 2.7805e-03,  1.2579e-02, -3.2661e-03],
          [ 1.6539e-02,  1.5941e-02,  2.5934e-03]],

         [[-1.7372e-02, -1.5669e-02, -1.7184e-02],
          [-1.0523e-02, -8.0881e-03, -3.5002e-03],
          [ 2.0012e-02,  1.3992e-02,  2.2567e-02]],

         ...,

         [[-1.8450e-03,  1.4391e-03, -4.8037e-03],
          [ 3.1779e-03, -2.1945e-03, -1.8111e-03],
          [-8.2320e-04, -5.2492e-03,  5.9751e-03]],

         [[-1.8042e-02, -1.9381e-02, -2.0262e-02],
          [-1.2160e-02, -1.6965e-02, -1.1955e-02],
          [-1.2115e-02, -2.2049e-02, -7.6491e-03]],

         [[-1.5930e-02, -1.5632e-02, -1.4184e-02],
          [-2.6613e-02, -2.4581e-02, -2.5748e-02],
          [-4.3730e-02, -2.4319e-02, -3.5868e-02]]],


        [[[ 2.5428e-02,  1.7873e-02,  3.8022e-03],
          [ 3.0997e-02,  2.7097e-02,  1.3571e-02],
          [ 4.2717e-02,  3.4481e-02,  1.6175e-02]],

         [[-1.5489e-02, -5.0627e-03,  1.2652e-03],
          [-1.0676e-02, -1.4705e-04,  6.0551e-03],
          [-1.5833e-02, -1.6241e-02, -8.2176e-03]],

         [[ 5.4370e-03, -9.6808e-03, -1.1396e-02],
          [ 8.2531e-03,  3.7010e-03,  1.4806e-02],
          [ 2.5946e-02,  3.4422e-02,  2.8250e-02]],

         ...,

         [[ 4.0576e-02,  4.6424e-02,  6.3164e-03],
          [ 2.3792e-02,  3.9974e-02,  1.2829e-02],
          [-2.2258e-02, -1.0163e-02, -2.6070e-02]],

         [[ 3.2659e-02,  3.8465e-02,  5.0303e-02],
          [ 1.5540e-02,  2.3043e-02,  2.1985e-02],
          [ 6.8735e-04, -1.1371e-02, -8.7360e-03]],

         [[-2.5060e-02, -2.7326e-02, -2.7092e-02],
          [-1.7381e-02, -2.3803e-02, -2.5497e-02],
          [-3.5137e-02, -3.5637e-02, -4.1381e-02]]],


        [[[ 6.4722e-03,  2.6112e-02,  1.4285e-02],
          [ 1.5717e-02,  1.4589e-02,  1.0102e-02],
          [ 3.1282e-04,  1.3287e-02, -1.4117e-03]],

         [[-3.0626e-02, -1.7090e-02, -1.8398e-02],
          [-1.3602e-02, -1.3641e-02, -1.7517e-05],
          [-4.3749e-03, -1.6990e-02, -5.9113e-03]],

         [[ 3.5263e-02,  6.0833e-02,  4.4315e-02],
          [ 2.2339e-02,  6.8715e-02,  2.7959e-02],
          [-3.1752e-03,  2.2407e-02,  1.5560e-02]],

         ...,

         [[ 9.8860e-04, -3.1928e-03,  1.3426e-02],
          [-3.6923e-03, -3.4468e-03,  3.3096e-02],
          [-1.2766e-02, -1.6451e-02,  8.1307e-03]],

         [[-7.9840e-03,  3.2893e-02,  4.4818e-02],
          [ 1.8329e-02,  3.8900e-02,  3.9412e-02],
          [-1.0024e-02,  5.2262e-03, -1.6413e-03]],

         [[ 7.7319e-03,  1.6902e-02, -3.2354e-03],
          [ 6.6349e-03, -1.1266e-02,  1.1672e-03],
          [ 3.5068e-03,  2.4610e-03,  4.2446e-02]]]])), ('features.26.bias', tensor([-1.8666e-03,  5.7095e-02,  2.9342e-01, -4.1835e-02, -1.4559e-01,
         9.7580e-02,  2.3287e-03, -4.6849e-02, -1.1053e-01,  3.6631e-02,
        -2.3670e-02,  1.9662e-01,  6.2942e-03,  1.0368e-01, -1.2430e-01,
        -5.5525e-02,  1.0667e-01,  2.8836e-01,  7.5442e-02,  4.5309e-02,
         7.1352e-02,  9.4569e-02, -1.0453e-01, -3.0553e-01, -1.4769e-01,
         1.5424e-01, -3.6026e-02, -1.6674e-02,  5.0073e-02, -1.0362e-01,
         1.6252e-01,  3.6867e-02, -5.6979e-02, -8.1772e-02,  2.0144e-01,
         7.0015e-02, -2.2859e-01,  1.3822e-01,  2.6113e-01,  2.1136e-02,
         1.0234e-01,  8.6473e-02,  6.1111e-02,  7.2767e-02,  6.9773e-03,
        -4.2054e-02,  1.0137e-01,  1.8389e-01,  9.8832e-02,  2.6407e-01,
         5.3378e-02,  1.6710e-01,  2.5089e-01,  1.1613e-01,  2.1970e-01,
         1.3894e-01, -4.7889e-02, -9.7952e-02,  1.0368e-01,  1.6410e-01,
         1.9025e-01,  7.4526e-02,  2.2013e-01,  9.4355e-02, -4.7882e-02,
         4.6833e-02, -3.9320e-03,  1.8785e-01, -2.2729e-02,  1.4750e-01,
         1.4188e-01,  1.8834e-01,  2.4944e-02,  2.1748e-01,  1.0304e-01,
         1.5125e-01,  1.7675e-01,  6.0383e-02,  1.6431e-01,  3.4881e-02,
         3.8004e-02, -6.8401e-02,  6.2248e-03,  1.3423e-02, -1.3956e-01,
         7.8097e-02,  1.9550e-01, -1.2594e-01,  9.6037e-02, -2.0711e-03,
         6.9357e-02, -1.6091e-01,  8.9944e-02,  2.5616e-01, -9.8200e-02,
         2.6589e-01, -2.3143e-02, -1.7001e-01, -2.4942e-04,  2.9673e-02,
         1.0278e-01,  1.5479e-01,  1.9948e-01, -2.8051e-01,  1.0574e-01,
         7.8208e-02,  6.1702e-02,  7.9237e-02,  1.7736e-03, -9.6903e-02,
         2.1890e-01, -3.3631e-02,  3.0116e-02,  2.6728e-01,  7.2655e-02,
         3.8347e-02,  4.4684e-02,  2.9473e-01,  2.6413e-02,  2.6462e-01,
         2.2294e-01, -1.7687e-01,  1.4487e-01,  2.5277e-01,  9.5677e-02,
         7.3535e-02,  1.2854e-01,  3.4688e-01,  1.1824e-01,  3.1590e-01,
        -8.2523e-02, -2.8264e-01,  2.5187e-01, -4.4773e-02,  8.9053e-02,
         2.1587e-03,  1.8896e-01,  1.6210e-01, -1.9770e-01,  1.5449e-01,
        -1.7553e-02, -1.6512e-02,  1.8990e-01,  6.1404e-02,  1.6946e-01,
        -2.7088e-02,  5.3145e-02,  1.0964e-01,  1.3800e-01,  6.7332e-02,
        -5.0629e-03, -1.7180e-01,  7.6077e-02, -1.2958e-02,  1.3120e-01,
        -8.2870e-02,  1.0818e-01,  1.1670e-01,  1.9102e-01, -2.6032e-01,
         1.2425e-01, -6.4174e-01, -9.4544e-02,  1.4883e-01, -2.2177e-02,
         1.9388e-01,  2.2708e-01, -3.0475e-02,  4.3636e-02,  2.5054e-02,
         4.8016e-02,  2.4943e-01,  8.6237e-02,  9.5355e-03,  6.0247e-03,
         1.5412e-01,  1.5840e-01,  1.3796e-01, -1.2680e-01,  1.3226e-01,
         4.6432e-02,  2.2256e-01,  2.6363e-01, -3.5001e-03,  1.8687e-01,
        -3.5546e-02,  2.9883e-04,  7.7087e-02,  7.4261e-02,  1.9941e-01,
        -2.8899e-02,  2.8666e-02,  2.2292e-03,  6.0504e-02,  1.2704e-01,
        -1.9055e-01,  1.4168e-01,  5.8124e-02,  2.5609e-02,  1.1290e-01,
         3.1867e-01, -6.8704e-02,  2.2565e-01,  1.5933e-01,  3.9752e-02,
         1.2825e-01,  1.4174e-01,  4.1308e-01,  4.6752e-02,  1.2245e-01,
         2.1968e-01,  4.9856e-02,  7.1631e-02, -3.9455e-02, -2.3028e-01,
         1.3458e-01, -4.2816e-02,  1.5429e-02, -6.6889e-01,  1.6270e-01,
         2.2208e-02, -1.7758e-01,  1.2783e-01,  2.1327e-02, -5.5212e-01,
         2.6010e-01,  8.0355e-02,  9.4295e-02, -7.3130e-02,  1.6812e-01,
         5.4281e-02,  1.4536e-01,  1.9376e-01,  3.5577e-01,  5.1165e-02,
         2.2360e-01,  2.3526e-01,  1.6229e-01,  9.5042e-03, -2.0074e-01,
         1.4703e-02, -2.0507e-01,  1.5991e-01, -1.1455e-01,  2.4596e-01,
         6.5557e-02,  1.0167e-01, -8.4635e-02, -3.6976e-01,  1.2340e-03,
        -5.0580e-02,  8.3523e-02, -2.8552e-01,  1.3614e-01,  1.2556e-01,
         2.7155e-01, -1.1871e-01,  1.4263e-02,  8.3877e-02, -2.1675e-02,
        -1.0315e-01,  4.0777e-02,  1.6204e-02, -6.4240e-02, -8.4088e-03,
         1.0339e-01, -3.2666e-02, -7.4288e-02, -5.5998e-02,  1.3324e-01,
        -1.2704e-01,  2.5314e-01,  2.7311e-01, -7.6727e-02,  1.6360e-01,
         1.4462e-01,  4.8776e-02,  1.2075e-01, -3.1966e-01,  6.8700e-02,
        -3.0422e-01,  5.1718e-02,  6.9389e-02, -5.4538e-03,  1.4129e-01,
        -2.4315e-01,  1.3872e-01,  7.0531e-02, -1.9635e-01,  2.3215e-01,
         5.3497e-02,  1.2996e-01,  2.3196e-01,  5.3783e-02, -3.2011e-01,
         9.7505e-02,  6.9466e-02,  1.2734e-01, -6.5295e-02,  1.3896e-01,
         9.7967e-02,  3.6168e-03, -4.9335e-02,  2.2809e-01, -1.8391e-01,
         8.4771e-02, -4.9345e-02,  3.6355e-02, -1.4925e-02, -3.3247e-02,
        -2.8801e-02,  7.3432e-02,  1.0934e-01,  2.1105e-01,  7.4307e-02,
        -3.3863e-02, -9.7055e-03, -4.4074e-02,  5.2093e-02,  7.3870e-02,
         2.2864e-01,  4.4315e-01, -2.6606e-01,  2.4656e-01,  8.8123e-03,
         2.6059e-01,  2.6270e-02,  4.9199e-03, -2.0948e-02,  2.3407e-01,
         4.6750e-02, -1.8637e-01, -6.0074e-02,  1.9932e-02,  1.2411e-01,
         6.9108e-02,  8.7628e-02,  6.0595e-02,  1.9305e-02,  7.3282e-03,
         2.7907e-01,  1.5810e-01,  1.4193e-01,  7.2068e-02,  1.2330e-01,
         2.2972e-01,  3.7316e-02,  2.7085e-01,  2.6735e-01,  2.9073e-01,
        -1.2664e-01, -1.7979e-01,  1.4586e-01, -1.6734e-01,  3.0067e-01,
         5.5059e-02,  3.3035e-02, -1.1998e-01,  9.2903e-02,  1.1212e-01,
         3.7626e-03,  1.4395e-01,  6.1938e-02, -1.2140e-02, -6.1718e-02,
         2.5250e-01,  1.3300e-01,  1.6234e-01,  8.2953e-02,  2.6083e-02,
         1.3916e-01,  2.0513e-01,  6.7912e-04, -1.7945e-01,  1.5764e-01,
        -3.8579e-02, -1.9392e-02,  1.2502e-01,  2.6850e-01,  1.0506e-01,
         5.5868e-03,  1.6505e-02,  6.3682e-03,  8.1427e-02,  6.6729e-02,
         5.5360e-02,  8.7517e-02, -4.0046e-02,  1.6139e-01,  7.1919e-02,
        -5.6358e-03,  2.1568e-01, -7.4366e-02,  5.8069e-02,  2.6335e-01,
         2.8281e-02,  2.4417e-01,  2.4759e-01, -2.9013e-02,  3.2379e-01,
         1.6893e-01,  1.3746e-01, -1.0394e-01,  9.3580e-02, -5.1710e-02,
         3.5181e-02,  1.4746e-01,  5.3799e-02,  4.1372e-02,  1.6984e-01,
         1.4468e-01, -1.4703e-01,  6.0515e-02,  6.3167e-02,  1.2524e-01,
         5.3194e-02,  7.6026e-02,  1.0579e-01,  9.8491e-02,  1.9020e-01,
         5.5204e-02,  3.1727e-01, -5.2387e-02,  1.3097e-01,  8.2818e-03,
         2.9184e-01,  5.8782e-02, -5.1021e-02, -4.2194e-02, -1.1820e-02,
        -1.4751e-02,  1.3293e-02, -5.1917e-02,  8.3116e-03,  5.2255e-02,
        -7.9446e-02,  1.5422e-01,  5.6511e-02, -1.6342e-01, -2.6140e-02,
        -1.4222e-01,  1.4183e-01,  1.5884e-02, -3.7037e-01,  1.0357e-01,
        -2.5953e-02,  2.1196e-03,  1.2330e-01, -2.9095e-01,  4.5272e-01,
         1.1890e-02,  5.3951e-02,  1.3336e-01,  1.4885e-01, -2.5333e-01,
         2.7634e-01,  1.9910e-01,  7.1031e-02, -4.5542e-02,  4.1901e-01,
         2.3511e-02,  9.1463e-02,  2.2576e-01, -7.0693e-02,  9.5964e-02,
         3.7641e-02,  3.4062e-02,  7.1019e-02,  3.3747e-02, -7.6930e-02,
         6.1839e-02,  9.1188e-02,  2.7430e-01,  7.1650e-02,  2.7827e-02,
         2.2714e-01,  9.9219e-02,  1.3663e-01,  1.4738e-01,  1.8030e-01,
         6.9251e-02,  2.0696e-02,  2.6268e-02,  7.3633e-02,  2.6631e-03,
         3.2248e-02,  2.3134e-01,  7.9280e-02,  5.9423e-02, -2.7435e-01,
         1.0282e-01, -3.1731e-01,  1.0250e-01,  7.7823e-02,  7.4229e-02,
         2.7291e-01,  2.0422e-01,  2.9676e-01,  1.1259e-01,  4.3181e-01,
         6.7201e-04,  1.2159e-02, -1.0741e-01, -1.4713e-01,  1.4593e-01,
         5.3302e-02,  2.0966e-01,  7.4471e-02,  1.6401e-01,  8.4423e-02,
         2.0856e-01, -1.4974e+00])), ('features.28.weight', tensor([[[[ 2.7768e-02,  1.5296e-02,  2.1911e-02],
          [ 2.5202e-02,  2.3223e-02,  2.0005e-02],
          [ 3.0154e-02,  8.7023e-03,  1.7728e-02]],

         [[-1.0682e-02, -9.5476e-03, -9.1195e-03],
          [-3.5036e-03, -1.2508e-02, -1.4557e-02],
          [-1.3689e-02, -1.8028e-02, -2.1646e-02]],

         [[-8.5565e-03, -7.2054e-03, -6.3846e-03],
          [ 2.0408e-03, -2.1947e-03, -6.8919e-04],
          [-1.6638e-03, -9.0286e-04,  4.9448e-04]],

         ...,

         [[-3.4711e-03,  3.3385e-03,  2.6684e-03],
          [-9.6592e-03, -1.1543e-02, -8.2975e-03],
          [ 3.4230e-03,  5.5182e-03,  1.2600e-02]],

         [[-6.8517e-03, -4.8486e-03, -8.5124e-03],
          [ 1.0570e-03,  1.1698e-02, -1.0812e-03],
          [ 6.2322e-03,  7.0932e-04, -1.5733e-03]],

         [[-2.1647e-02,  2.5883e-03,  1.1418e-02],
          [-2.7891e-02,  1.8448e-03,  1.1855e-02],
          [-1.2538e-02, -1.8912e-03,  9.2639e-03]]],


        [[[-1.1915e-02, -2.5141e-02, -5.7179e-03],
          [-1.0882e-02, -2.0027e-02, -1.1911e-02],
          [-1.1790e-02, -2.5523e-03, -9.7380e-03]],

         [[ 4.7855e-03,  1.2190e-02,  2.7961e-03],
          [ 1.0504e-03,  1.1996e-02,  4.9763e-03],
          [-8.5489e-03,  7.1493e-03, -1.0951e-03]],

         [[ 2.2856e-02, -2.7013e-04, -1.2531e-02],
          [ 2.3324e-02, -4.0162e-03, -6.5110e-03],
          [ 2.1377e-02, -8.4313e-03, -1.5131e-02]],

         ...,

         [[-1.5753e-03, -9.9031e-03, -8.8476e-03],
          [-5.7730e-03, -5.1446e-04, -7.1723e-03],
          [-2.2436e-02, -9.8933e-03, -1.9306e-02]],

         [[ 2.5404e-03,  8.9606e-03, -5.4400e-03],
          [ 1.3366e-02,  2.0605e-02,  6.6010e-03],
          [ 1.8054e-02,  3.1267e-02,  2.4730e-02]],

         [[-1.4774e-03,  1.2404e-02,  8.4087e-03],
          [ 1.2018e-02,  1.7658e-02,  1.7988e-02],
          [-3.6130e-04,  1.8112e-02,  1.8274e-02]]],


        [[[-9.2360e-03,  7.4191e-04,  2.9408e-03],
          [ 2.4742e-03, -4.0349e-03, -2.9401e-03],
          [-1.5432e-03, -5.3605e-03, -5.8344e-03]],

         [[-1.3595e-02, -3.1718e-02, -2.3710e-02],
          [-2.1746e-02, -2.5402e-02, -2.3455e-02],
          [-1.5045e-02, -3.1418e-02, -2.8699e-02]],

         [[ 3.2991e-03, -4.9208e-03,  1.4358e-03],
          [-7.7625e-04,  6.4103e-03,  3.9225e-03],
          [ 1.0592e-02,  5.9198e-03,  1.5063e-02]],

         ...,

         [[-4.8337e-03, -1.5062e-02, -1.1133e-02],
          [ 4.8897e-03,  3.7414e-03, -6.6763e-03],
          [ 1.0834e-02,  1.6787e-02,  6.9389e-03]],

         [[-2.0545e-02, -2.2203e-02, -1.7161e-02],
          [-2.5112e-02, -3.0551e-02, -1.5765e-02],
          [-2.4664e-02, -2.2903e-02, -5.8698e-03]],

         [[-3.2173e-02, -2.9189e-02, -8.3404e-03],
          [-2.5504e-02, -1.6742e-02,  1.7872e-03],
          [-3.1295e-02, -1.2420e-02,  1.1523e-02]]],


        ...,


        [[[-1.9429e-02, -2.4556e-02, -1.7622e-02],
          [-3.5300e-02, -3.0947e-02, -2.4672e-02],
          [-2.4305e-02, -2.5179e-02, -7.1441e-03]],

         [[ 2.9619e-02,  1.2602e-02, -1.9829e-02],
          [ 9.1760e-03, -8.5109e-04, -3.0802e-02],
          [-2.7310e-03, -1.7747e-02, -3.2944e-02]],

         [[-3.7120e-03, -1.0129e-02,  1.1997e-02],
          [-5.0915e-03, -1.4651e-02,  1.0667e-02],
          [-4.8322e-03, -9.9947e-03,  1.8547e-03]],

         ...,

         [[-1.4648e-02, -1.5231e-02,  1.0567e-03],
          [-8.6118e-03, -3.1389e-02, -1.3612e-02],
          [-1.7457e-02, -1.7559e-02, -1.1778e-02]],

         [[-1.4624e-02, -8.1732e-03, -2.6069e-03],
          [-1.8911e-02, -2.5938e-02, -1.7402e-02],
          [-3.9192e-03, -1.7547e-02, -2.6254e-02]],

         [[-5.1161e-02, -1.9841e-02,  1.4722e-02],
          [-4.5486e-02, -1.1310e-02,  1.3356e-02],
          [-5.4183e-02, -2.0307e-02, -2.4845e-03]]],


        [[[-4.0532e-03, -1.0636e-02,  7.1217e-04],
          [ 1.4047e-02,  1.0330e-02,  1.1886e-02],
          [ 1.9057e-02,  7.6312e-03,  1.1955e-02]],

         [[-5.0939e-04,  2.6748e-03,  3.8110e-03],
          [-1.6356e-02, -2.5871e-03, -9.2277e-03],
          [-5.9132e-03, -3.3246e-03, -2.0477e-02]],

         [[ 1.0108e-03,  1.5062e-02,  2.3413e-02],
          [ 4.2264e-05,  6.6031e-03,  3.2643e-02],
          [-2.8598e-03,  4.1518e-03,  2.0333e-02]],

         ...,

         [[ 5.1414e-03, -6.4583e-03, -1.4588e-02],
          [-1.0115e-02, -1.0200e-02, -2.1285e-02],
          [-6.3856e-03, -7.5624e-03, -2.0476e-02]],

         [[-1.0839e-02,  6.7214e-03,  5.8918e-03],
          [-9.5600e-04,  1.6651e-03,  7.1670e-03],
          [-1.8902e-02, -7.4955e-03, -9.8708e-04]],

         [[-4.4182e-02, -2.7011e-02, -1.5440e-02],
          [-4.1249e-02, -2.9579e-02, -1.0295e-02],
          [-1.9288e-02, -9.9171e-03,  5.1636e-03]]],


        [[[-2.9454e-02, -2.0776e-02, -1.4369e-02],
          [-8.1482e-03, -1.6480e-02, -1.4024e-02],
          [-8.4481e-03, -2.4206e-02, -1.5236e-02]],

         [[ 5.7170e-03,  1.4719e-02,  8.7575e-03],
          [ 7.4073e-03, -8.5165e-03, -1.1737e-02],
          [-2.1247e-03, -1.4506e-02, -1.4657e-02]],

         [[ 3.0560e-02,  4.0275e-02,  5.0865e-02],
          [-2.9477e-03,  2.0548e-02,  4.3352e-02],
          [-1.6921e-02,  4.7982e-03,  2.1169e-02]],

         ...,

         [[-1.9884e-02, -2.8676e-02, -1.7745e-02],
          [-1.8820e-02, -2.7692e-02, -3.7976e-02],
          [-7.1567e-03, -1.6576e-02, -6.9290e-03]],

         [[-3.3155e-03, -8.4667e-03,  4.0157e-03],
          [ 1.9905e-02, -1.0356e-02, -4.5904e-04],
          [ 3.1526e-02,  1.0053e-02,  1.1222e-02]],

         [[-2.6271e-02, -8.1591e-03, -2.9560e-02],
          [-3.3923e-02, -2.4079e-02, -2.2005e-02],
          [-3.4229e-02, -2.6150e-02, -1.4213e-02]]]])), ('features.28.bias', tensor([ 1.2299e-01,  1.9062e-02,  2.3202e-01,  5.8209e-02,  1.6951e-01,
         9.3987e-02,  1.5288e-01,  3.5992e-02, -1.0673e-02,  4.5524e-02,
        -3.5247e-02,  2.5516e-02,  3.7165e-01,  7.4319e-02, -5.5337e-02,
         1.8086e-01,  9.7370e-03,  2.6187e-01,  1.8216e-01,  8.2105e-02,
         1.6739e-01,  1.6799e-02, -7.1030e-02,  2.5600e-01,  1.1929e-01,
        -6.0356e-02, -7.9072e-02,  2.1399e-02,  1.5857e-01,  1.0256e-01,
         1.5698e-01,  1.0011e-01, -3.1958e-02,  1.2926e-01,  6.9638e-02,
        -6.4992e-02, -2.9777e-02,  1.4160e-01,  1.9333e-01, -5.3614e-02,
         1.7314e-02,  3.4937e-01,  5.4955e-01,  5.8277e-02,  1.8567e-01,
        -5.6476e-02,  5.7856e-02, -3.3354e-01,  1.4938e-01, -4.4627e-02,
         2.2324e-01, -1.3016e-01,  6.6589e-03,  1.7766e-01,  6.1969e-02,
        -2.4899e-01,  7.3821e-02,  9.5302e-02,  1.0045e-02, -5.1411e-02,
         1.2429e-01,  1.0792e-01, -4.1483e-02,  9.6371e-02, -1.0660e-01,
         7.5465e-02,  2.5620e-01,  1.4411e-01, -2.2501e-02,  1.0363e-01,
         7.0449e-02,  1.1813e-01,  3.5013e-02, -1.6152e-01,  7.5051e-02,
         1.4182e-01,  2.1379e-01,  4.5386e-02,  2.3022e-01,  1.0673e-01,
        -2.7411e-01, -8.0965e-03,  1.5953e-01,  1.0124e-01,  1.3451e-01,
         6.2137e-02, -6.4873e-02,  5.2526e-02,  7.6597e-02,  4.9359e-02,
         6.2304e-02, -3.2635e-02, -4.7491e-02,  1.3554e-01, -1.8428e-02,
         6.4935e-03,  3.0955e-02,  3.1089e-01,  7.0068e-02, -1.8541e-02,
        -1.3481e-01, -1.2601e-01,  1.9559e-01,  3.4075e-02,  1.6061e-01,
         5.2857e-02,  7.6637e-02,  2.2150e-01,  3.9940e-02,  6.1567e-02,
         7.4801e-02,  1.4435e-01, -6.7993e-02, -2.0014e-01,  3.0571e-01,
        -4.5313e-02,  2.4059e-01,  5.3480e-01,  1.7807e-01,  4.9351e-01,
         7.4024e-03,  3.5002e-02,  2.4675e-01,  3.1102e-01,  5.3972e-02,
         1.4723e-01, -2.9065e-02,  4.0776e-01,  1.9019e-01, -6.0330e-02,
        -1.7002e-02,  2.4975e-01,  2.1960e-01,  3.6960e-01,  3.0740e-02,
         4.3709e-01,  8.8497e-02, -2.7574e-01, -6.6411e-03,  1.4975e-01,
         1.9137e-01,  1.3468e-01,  1.9793e-02,  7.0597e-02, -1.0223e-04,
         6.3679e-02,  6.4095e-02, -4.9774e-02,  1.3181e-01,  1.3314e-01,
        -1.1899e-02, -3.5992e-03, -7.3270e-02,  1.5903e-02,  2.0310e-02,
         1.2016e-01,  1.5365e-01, -1.3392e-01,  2.9884e-01,  6.2440e-02,
         2.6438e-01,  6.6528e-02,  2.2115e-02, -6.3780e-02,  1.2955e-01,
        -1.1588e-01,  1.5341e-02,  1.8381e-01, -7.1448e-02,  6.3515e-02,
         7.3416e-02,  3.3285e-01,  2.4135e-01,  1.2293e-01, -3.6733e-02,
        -2.2642e-01,  9.4244e-02,  6.4020e-02,  6.4169e-02,  1.6127e-01,
         1.1205e-01,  2.3402e-01,  4.0610e-02, -1.0696e-01, -8.1177e-02,
         6.2745e-02, -2.9593e-02,  9.2280e-02, -9.8356e-02,  4.2653e-02,
        -7.1865e-02,  7.6488e-02,  2.9805e-02,  1.6318e-01,  2.2079e-01,
         2.2230e-01, -5.1637e-04,  7.1988e-02, -4.2184e-03,  2.3270e-01,
         2.0941e-01,  7.9699e-02, -8.6314e-02,  1.7086e-02,  5.4669e-02,
        -8.9527e-03,  5.0897e-01,  7.7975e-03,  1.8228e-01,  6.4333e-02,
         7.2739e-01,  4.5106e-02,  1.4373e-01, -3.7722e-02, -5.4909e-02,
        -1.2010e-02,  2.0435e-01,  1.7225e-01,  4.0681e-02,  1.9134e-02,
         6.2492e-02,  1.3200e-02,  1.3521e-01,  8.0993e-02,  9.5284e-02,
         2.5035e-01, -2.1631e-02,  4.1494e-02,  3.2249e-02,  1.2096e-01,
        -4.0207e-03,  4.0679e-02,  3.6975e-01,  1.5898e-02, -2.2886e-02,
         2.4626e-02, -2.7666e-01, -2.3504e-02,  1.0643e-01, -1.2430e-02,
         1.7485e-01,  5.4469e-02,  8.5420e-02,  1.9319e-01,  9.9808e-02,
         4.6577e-02,  2.5018e-01,  1.4844e-01,  2.0588e-01, -3.0332e-03,
         2.9574e-02,  1.3161e-01,  2.5354e-02,  1.0219e-01,  1.3147e-01,
        -7.8081e-02,  2.3178e-02, -1.8245e-01, -2.0426e-02,  5.6247e-02,
         2.0667e-02, -1.6488e-01, -1.0449e-01, -2.4995e-02, -1.4024e-02,
         1.5887e-02,  1.3549e-01,  1.7865e-01,  6.9024e-02,  2.0019e-01,
         8.3336e-02,  2.3189e-01,  1.1164e-01,  5.2018e-02,  5.4957e-02,
         8.3962e-03,  3.8536e-02,  1.2274e-01,  1.1808e-01,  4.2507e-01,
         9.5482e-02, -2.2675e-02,  7.5627e-02,  1.8008e-01, -1.0889e-01,
         4.2092e-02,  1.9957e-01, -2.4369e-01, -2.8168e-02,  4.5333e-02,
         4.4138e-02,  3.6140e-01, -4.1163e-02,  1.2387e-01,  3.3204e-02,
         2.3844e-01, -1.0794e-02,  6.9760e-02,  1.5946e-01,  8.4266e-02,
         5.7439e-02, -4.1239e-02, -5.9942e-02,  1.3035e-02, -3.6432e-02,
        -5.6892e-02,  9.5882e-02, -1.7123e-01,  1.8914e-01,  1.2670e-01,
        -4.2537e-02, -1.0869e-02,  5.0380e-02,  1.9144e-01,  2.9454e-01,
        -5.7837e-02,  9.6131e-02,  1.9973e-01,  6.1776e-02,  2.4677e-01,
         2.4367e-01, -3.3549e-02,  6.4847e-02,  1.4388e-01, -3.6591e-02,
         4.4307e-02,  3.0094e-02,  2.3947e-02, -6.4356e-02,  1.8527e-01,
        -2.0822e-01, -3.5492e-02,  1.3414e-01,  4.5296e-02, -2.8097e-02,
         1.3039e-01,  1.0102e-02, -6.0756e-03,  9.2639e-02,  1.7997e-01,
         1.2552e-01,  1.1525e-02,  1.3936e-01,  9.2723e-03, -1.2091e-01,
        -2.0337e-02,  1.3993e-01,  1.4385e-01,  1.8340e-01,  1.0171e-01,
         4.5209e-02,  7.4639e-02, -1.0024e-01,  7.0049e-02,  7.4891e-02,
         5.7438e-02,  2.0400e-01,  1.2844e-01,  8.0494e-02,  8.6971e-02,
         5.5280e-04, -1.5109e-01,  1.0077e-02,  2.4397e-01,  3.6528e-02,
         5.3695e-02,  1.1937e-01,  9.8878e-02, -4.1363e-02, -6.1172e-03,
         1.0696e-01,  1.0583e-01,  3.1789e-01,  1.2105e-02,  3.6966e-02,
         3.8884e-02,  1.3207e-05, -1.8045e-01,  9.2949e-02,  3.5579e-01,
         1.7562e-01,  5.2235e-02,  2.8717e-01,  8.8601e-02,  1.0816e-01,
        -2.2063e-02,  3.6931e-02,  3.1340e-02, -1.8423e-02,  1.6814e-01,
        -4.6887e-04,  1.9825e-01,  1.3459e-01,  4.2007e-02,  9.2315e-03,
         8.7292e-02, -3.2945e-02,  3.2598e-01,  1.0763e-01,  6.9619e-04,
         1.0203e-02,  6.9988e-02, -1.1367e-02,  1.4867e-01, -2.0369e-01,
         5.6526e-02, -9.1067e-02,  1.9459e-02,  1.0080e-01,  1.8429e-01,
         1.6015e-01,  1.8134e-01,  1.1695e-01,  6.5061e-02,  9.7136e-02,
         1.9571e-01,  1.8977e-01,  5.2180e-02, -1.0870e-01,  1.3085e-01,
         4.5247e-02,  1.2772e-02, -3.9641e-02, -1.8610e-01, -7.0604e-02,
         1.2044e-01, -4.8821e-02, -2.8440e-02, -1.0632e-02,  1.0908e-01,
         5.3787e-02,  1.1652e-01, -2.9447e-02,  4.0321e-01, -6.4734e-02,
         2.2914e-02,  8.8240e-02,  3.1470e-02,  3.6577e-03,  3.0137e-01,
         6.8193e-02, -6.1503e-02,  7.1662e-02,  2.6561e-02,  3.5378e-01,
        -1.0535e-01,  1.1304e-01,  9.0590e-02,  3.2702e-03,  5.7275e-02,
         5.1514e-01,  4.9554e-02,  1.0499e-01,  9.2485e-04,  2.9589e-01,
        -6.7953e-02,  7.7629e-02, -1.7351e-01, -2.4828e-01,  2.9132e-01,
         1.0269e-01, -2.5470e-02,  4.2276e-01,  5.6362e-02, -2.1826e-02,
         2.7908e-01,  2.4711e-01, -2.0559e-02,  4.1033e-01,  1.0646e-01,
        -1.0769e-01,  3.2404e-02,  7.8538e-03,  2.2381e-02,  8.8990e-02,
         9.1920e-02,  4.2402e-02,  1.6965e-01,  1.5932e-01,  5.8500e-01,
         4.4016e-02,  8.4680e-02,  1.5562e-02,  5.3686e-02,  7.5615e-03,
        -1.7018e-02,  6.9369e-02,  1.9750e-01,  2.6956e-02, -4.0056e-02,
        -4.6108e-03,  1.8972e-01,  1.3781e-02,  8.0803e-02, -1.0054e-02,
         2.1246e-01,  1.3612e-01, -7.6917e-01,  4.1772e-02,  5.9762e-02,
         1.0543e-03, -1.5168e-02,  2.7847e-01,  5.2689e-02,  1.2394e-01,
         3.0762e-02,  1.4299e-01,  1.2184e-02,  3.3403e-02, -1.4907e-02,
        -6.7975e-02,  3.4594e-01])), ('classifier.fc1.weight', tensor([[-2.7394e-03, -3.0392e-03,  9.1879e-03,  ..., -5.5991e-03,
         -4.2313e-03,  1.0408e-04],
        [-1.1859e-02, -2.1217e-03, -5.7629e-03,  ...,  9.1476e-04,
         -4.6563e-03, -1.7294e-03],
        [-5.8541e-03, -3.4162e-03, -4.2160e-03,  ...,  4.0657e-03,
         -1.9849e-02, -9.9485e-03],
        ...,
        [-3.3692e-03, -2.9848e-03, -5.6568e-03,  ..., -7.8855e-03,
          1.1407e-02, -5.0311e-03],
        [-3.5182e-04,  3.0764e-03,  3.9197e-05,  ..., -3.0785e-03,
         -1.1953e-02, -5.6203e-03],
        [-1.0778e-04, -9.9686e-03, -1.2008e-02,  ...,  6.6939e-03,
         -6.8620e-03, -9.5102e-03]])), ('classifier.fc1.bias', tensor([-0.0087, -0.0056, -0.0133,  ..., -0.0073, -0.0070, -0.0108])), ('classifier.fc2.weight', tensor([[-0.0151,  0.0075,  0.0210,  ...,  0.0060, -0.0048, -0.0108],
        [ 0.0075, -0.0097, -0.0067,  ...,  0.0010,  0.0036, -0.0120],
        [ 0.0101,  0.0044,  0.0150,  ..., -0.0146, -0.0145, -0.0139],
        ...,
        [ 0.0013, -0.0156,  0.0101,  ..., -0.0179,  0.0085, -0.0117],
        [-0.0176, -0.0144,  0.0023,  ..., -0.0155, -0.0067,  0.0099],
        [-0.0153,  0.0059,  0.0108,  ..., -0.0004,  0.0179,  0.0028]])), ('classifier.fc2.bias', tensor([-0.0029, -0.0124,  0.0001,  ..., -0.0072,  0.0067, -0.0014])), ('classifier.fc3.weight', tensor([[ 2.8789e-03, -3.2417e-03, -6.4997e-02,  ..., -1.0320e-02,
         -2.6629e-02, -6.8893e-02],
        [-2.1956e-02,  3.2795e-04, -1.6117e-02,  ..., -2.2151e-02,
         -1.6816e-02, -3.7984e-02],
        [-4.4090e-02, -5.7574e-02, -8.1493e-03,  ...,  3.8017e-03,
         -2.5600e-03, -1.0791e-02],
        ...,
        [-1.5313e-02, -3.3118e-02, -3.9715e-06,  ..., -9.0728e-04,
          1.0053e-05, -1.7751e-02],
        [-7.0767e-04, -1.5823e-02, -4.7706e-02,  ..., -1.0936e-02,
         -1.3074e-02,  1.8178e-02],
        [-6.0275e-04,  5.1613e-03, -9.4206e-03,  ...,  1.1948e-02,
         -1.2295e-02, -4.9123e-02]])), ('classifier.fc3.bias', tensor([ 0.0119, -0.0171,  0.0106,  0.0173, -0.0370, -0.0075,  0.0221,  0.0018,
        -0.0094,  0.0063, -0.0071, -0.0110,  0.0203, -0.0158, -0.0141, -0.0012,
        -0.0088,  0.0005,  0.0158,  0.0257,  0.0130,  0.0008,  0.0037, -0.0227,
         0.0038,  0.0229,  0.0017,  0.0274,  0.0098,  0.0296,  0.0164, -0.0158,
         0.0232, -0.0210,  0.0035, -0.0037, -0.0030,  0.0078, -0.0100,  0.0190,
         0.0085,  0.0065,  0.0298, -0.0046, -0.0072, -0.0084,  0.0063, -0.0041,
         0.0027, -0.0125,  0.0259,  0.0058, -0.0140, -0.0005,  0.0083,  0.0184,
         0.0152,  0.0113, -0.0240, -0.0322,  0.0093, -0.0016, -0.0039, -0.0049,
         0.0277,  0.0078,  0.0022, -0.0093, -0.0177, -0.0120,  0.0184, -0.0033,
        -0.0176,  0.0033, -0.0020, -0.0053, -0.0065,  0.0055,  0.0020, -0.0224,
         0.0003, -0.0015, -0.0179,  0.0050, -0.0023,  0.0002,  0.0096, -0.0097,
         0.0115, -0.0134, -0.0102, -0.0057, -0.0172,  0.0034, -0.0151, -0.0007,
        -0.0014,  0.0178,  0.0222,  0.0102,  0.0223, -0.0309]))]), 'optimizer': {'state': {0: {'step': tensor(410.), 'exp_avg': tensor([[ 3.1383e-23,  2.0320e-23, -2.2554e-23,  ...,  4.4419e-23,
          5.0373e-23,  4.0660e-23],
        [ 2.0509e-23,  2.3032e-23,  4.2153e-24,  ...,  1.9254e-23,
          1.3230e-23,  1.0698e-23],
        [ 5.3494e-24,  1.5538e-23,  2.1594e-24,  ...,  3.1589e-24,
          5.1989e-14,  3.0220e-24],
        ...,
        [ 2.4592e-24,  1.4734e-23,  2.0477e-24,  ...,  3.1513e-24,
         -1.2881e-23, -4.6643e-25],
        [-1.0744e-24, -2.6507e-24,  4.6166e-24,  ...,  1.2509e-23,
          5.8562e-24,  3.2951e-23],
        [ 8.0249e-24,  2.9196e-23,  1.2764e-23,  ..., -3.5628e-24,
          9.6739e-24,  3.9654e-24]]), 'exp_avg_sq': tensor([[4.9153e-10, 3.2537e-10, 3.0660e-10,  ..., 1.1077e-09, 1.2006e-09,
         1.5634e-09],
        [2.8029e-10, 6.8695e-10, 1.4901e-11,  ..., 3.7576e-10, 2.0983e-10,
         7.3088e-11],
        [4.1443e-11, 3.4963e-10, 6.7529e-12,  ..., 2.2584e-11, 5.7014e-11,
         1.6312e-11],
        ...,
        [4.9471e-11, 3.1442e-10, 6.0728e-12,  ..., 2.0358e-11, 2.9638e-10,
         3.4421e-10],
        [2.9572e-12, 2.7152e-11, 3.9463e-11,  ..., 1.2907e-10, 3.9554e-11,
         4.4169e-10],
        [8.6785e-11, 7.6452e-10, 1.2406e-10,  ..., 4.2579e-11, 1.6716e-10,
         3.6096e-11]])}, 1: {'step': tensor(410.), 'exp_avg': tensor([1.0342e-22, 9.6162e-23, 9.8138e-14,  ..., 8.6237e-23, 5.3945e-23,
        5.7980e-23]), 'exp_avg_sq': tensor([1.1864e-08, 1.3650e-08, 4.6549e-10,  ..., 1.2111e-08, 2.0261e-09,
        2.5035e-09])}, 2: {'step': tensor(410.), 'exp_avg': tensor([[ 5.9072e-24,  2.3712e-22, -1.3924e-23,  ..., -1.4976e-23,
          7.7586e-24, -6.4641e-25],
        [ 2.2931e-22,  8.7394e-22,  8.0361e-24,  ...,  2.0489e-22,
          2.9576e-22,  1.4747e-22],
        [ 6.0508e-23,  1.1216e-21, -8.3849e-16,  ...,  2.2355e-22,
          1.0323e-22,  1.8323e-22],
        ...,
        [ 2.9697e-23,  2.9544e-23, -9.6602e-24,  ...,  1.0302e-24,
          0.0000e+00,  7.5954e-24],
        [ 2.8370e-22,  3.7542e-22, -3.1087e-23,  ...,  9.2529e-23,
          2.5235e-22,  1.0458e-23],
        [ 1.7886e-23,  0.0000e+00,  0.0000e+00,  ..., -4.2618e-24,
         -9.6353e-24,  1.3284e-23]]), 'exp_avg_sq': tensor([[1.2050e-10, 7.7444e-08, 3.4628e-10,  ..., 1.4220e-09, 7.2993e-11,
         9.8251e-12],
        [4.4987e-08, 9.9044e-07, 7.2574e-11,  ..., 4.8582e-08, 1.1615e-07,
         2.8741e-08],
        [2.5743e-09, 1.6470e-06, 2.6548e-10,  ..., 1.0396e-07, 1.4874e-08,
         5.2797e-08],
        ...,
        [1.5752e-09, 1.5591e-09, 1.6669e-10,  ..., 1.8957e-12, 0.0000e+00,
         1.0304e-10],
        [1.1827e-07, 1.1615e-07, 1.1160e-09,  ..., 2.0046e-08, 5.9379e-08,
         4.7015e-09],
        [5.7144e-10, 0.0000e+00, 0.0000e+00,  ..., 3.2443e-11, 1.6583e-10,
         3.1518e-10]])}, 3: {'step': tensor(410.), 'exp_avg': tensor([-7.1761e-06,  2.1548e-04,  1.7345e-04,  ...,  1.8400e-11,
         3.3604e-10, -4.1948e-05]), 'exp_avg_sq': tensor([1.2024e-07, 2.9127e-07, 5.1090e-07,  ..., 1.7705e-08, 5.8001e-08,
        2.0763e-07])}, 4: {'step': tensor(410.), 'exp_avg': tensor([[ 3.4310e-10,  2.7986e-05,  7.4655e-06,  ...,  5.2484e-16,
          1.3553e-15,  1.1882e-08],
        [ 9.5973e-13,  4.4620e-06, -7.4881e-03,  ...,  2.5935e-18,
          7.0130e-15,  1.6277e-08],
        [ 1.3834e-09,  2.4604e-06, -7.2629e-04,  ...,  6.3933e-17,
          3.8737e-13,  8.2243e-07],
        ...,
        [ 1.3516e-11,  1.3105e-04,  2.4310e-05,  ...,  2.1646e-16,
          3.5396e-14,  1.7438e-07],
        [ 3.8497e-14,  1.8340e-04,  1.6151e-05,  ...,  2.8460e-15,
          2.0545e-15,  1.2973e-07],
        [ 5.3146e-11,  6.1162e-04,  2.6239e-05,  ...,  9.3328e-16,
          2.0152e-10,  4.2860e-06]]), 'exp_avg_sq': tensor([[2.5341e-05, 3.1621e-06, 2.3700e-06,  ..., 8.7375e-10, 4.5386e-09,
         1.7455e-06],
        [2.0623e-06, 1.7093e-05, 1.1800e-04,  ..., 1.2327e-06, 7.8694e-06,
         7.2166e-09],
        [5.4089e-06, 4.3364e-09, 9.3223e-05,  ..., 5.5077e-09, 2.2855e-09,
         5.8640e-07],
        ...,
        [2.6091e-05, 1.9831e-06, 1.0122e-05,  ..., 1.8642e-08, 2.0723e-09,
         1.6646e-05],
        [5.1234e-05, 7.4402e-06, 3.6668e-07,  ..., 4.7705e-09, 1.5452e-08,
         1.5570e-05],
        [4.9598e-06, 6.9343e-06, 3.4863e-05,  ..., 9.9590e-09, 3.4121e-09,
         1.2328e-06]])}, 5: {'step': tensor(410.), 'exp_avg': tensor([-2.4629e-04, -4.9091e-03,  1.7469e-03, -1.6781e-03,  1.9464e-03,
         1.9295e-04,  2.9864e-03, -1.8812e-03,  1.3055e-03,  8.4967e-04,
         1.3403e-03,  1.0531e-03, -1.0984e-03, -4.2483e-03, -1.1335e-03,
         2.4777e-03,  6.2115e-04, -4.0900e-03,  1.0637e-03, -1.9020e-03,
         4.4933e-04,  3.1690e-03, -9.2997e-05, -2.9902e-04,  2.2957e-03,
         4.8074e-04,  3.8007e-03,  9.3213e-04,  6.1289e-05, -1.6906e-03,
         4.1131e-04,  1.3560e-03, -7.0754e-04, -2.3047e-03, -5.9867e-03,
        -2.1723e-03,  4.6545e-03, -7.2764e-04, -7.4179e-04, -2.8684e-03,
         4.8080e-03,  7.5174e-04,  2.2277e-03, -1.3763e-04, -4.1168e-05,
        -6.0887e-04,  1.9661e-03, -2.4294e-03, -1.5083e-03, -1.3992e-03,
        -7.1661e-03, -5.1955e-03, -3.5663e-03, -1.7102e-03, -3.7621e-04,
        -3.6600e-03, -7.3551e-04,  1.9606e-04, -6.3587e-04, -3.3555e-04,
         1.2446e-03, -3.9483e-03,  4.6527e-04,  6.0639e-04,  4.7268e-04,
        -2.0285e-03,  2.1796e-03,  2.6942e-03,  1.1708e-03,  3.7687e-03,
         1.4596e-04,  3.8179e-04, -2.1194e-03, -3.2130e-03, -6.1597e-04,
        -1.8262e-03,  1.1805e-03,  2.2102e-03,  3.3091e-03,  8.7356e-04,
        -2.6037e-03,  5.9817e-04, -1.9638e-03,  2.8231e-03, -4.1214e-04,
         3.3653e-04, -6.6163e-04,  1.1434e-04,  1.7586e-03,  1.9866e-03,
        -5.7789e-03,  2.8173e-03,  9.8579e-04,  5.9674e-03,  2.5273e-03,
         4.5806e-03,  1.9204e-03,  1.1998e-03, -2.2779e-03,  1.1912e-03,
        -6.5921e-04,  3.7388e-03]), 'exp_avg_sq': tensor([3.4422e-05, 5.1769e-05, 4.4631e-05, 7.8401e-05, 3.8908e-05, 1.0831e-04,
        6.5113e-05, 3.8726e-05, 4.9412e-05, 5.0077e-05, 5.1270e-05, 4.1025e-05,
        9.1000e-05, 5.7318e-05, 4.0323e-05, 7.0132e-05, 4.1411e-05, 4.1913e-05,
        3.3356e-05, 4.2223e-05, 3.1570e-05, 5.0624e-05, 1.9379e-05, 6.7579e-05,
        1.0756e-04, 6.6686e-05, 7.3813e-05, 6.3967e-05, 5.5642e-05, 3.4815e-05,
        3.9332e-05, 3.4613e-05, 7.5187e-05, 5.8074e-05, 5.3353e-05, 5.1582e-05,
        7.5680e-05, 6.6831e-05, 1.0935e-04, 6.1697e-05, 1.1810e-04, 5.2687e-05,
        5.1282e-05, 1.4797e-04, 2.8394e-05, 7.3114e-05, 2.6089e-05, 7.7856e-05,
        5.8202e-05, 2.7097e-04, 7.9933e-05, 9.3256e-05, 4.8372e-05, 7.7057e-05,
        5.9328e-05, 9.5894e-05, 4.5226e-05, 5.3036e-05, 2.3810e-05, 3.3778e-05,
        4.9949e-05, 6.3999e-05, 3.3560e-05, 3.5499e-05, 9.5087e-05, 4.3770e-05,
        5.6260e-05, 6.5148e-05, 5.0291e-05, 3.9065e-05, 4.8109e-05, 5.6321e-05,
        9.8691e-05, 1.2745e-04, 1.4727e-04, 8.6081e-05, 8.1806e-05, 7.5544e-05,
        1.1820e-04, 2.8050e-05, 6.3272e-05, 5.6098e-05, 1.4168e-04, 1.1103e-04,
        1.2210e-04, 9.9845e-05, 5.6405e-05, 5.3640e-05, 8.1954e-05, 1.3232e-04,
        1.5251e-04, 5.9278e-05, 9.1385e-05, 7.4763e-05, 5.2126e-05, 4.5083e-05,
        9.2784e-05, 1.4600e-04, 1.3157e-04, 8.2707e-05, 8.8368e-05, 4.9737e-05])}}, 'param_groups': [{'lr': 0.001, 'betas': (0.9, 0.999), 'eps': 1e-08, 'weight_decay': 0, 'amsgrad': False, 'maximize': False, 'foreach': None, 'capturable': False, 'differentiable': False, 'fused': None, 'params': [0, 1, 2, 3, 4, 5]}]}, 'class_to_idx': {'1': 0, '10': 1, '100': 2, '101': 3, '102': 4, '11': 5, '12': 6, '13': 7, '14': 8, '15': 9, '16': 10, '17': 11, '18': 12, '19': 13, '2': 14, '20': 15, '21': 16, '22': 17, '23': 18, '24': 19, '25': 20, '26': 21, '27': 22, '28': 23, '29': 24, '3': 25, '30': 26, '31': 27, '32': 28, '33': 29, '34': 30, '35': 31, '36': 32, '37': 33, '38': 34, '39': 35, '4': 36, '40': 37, '41': 38, '42': 39, '43': 40, '44': 41, '45': 42, '46': 43, '47': 44, '48': 45, '49': 46, '5': 47, '50': 48, '51': 49, '52': 50, '53': 51, '54': 52, '55': 53, '56': 54, '57': 55, '58': 56, '59': 57, '6': 58, '60': 59, '61': 60, '62': 61, '63': 62, '64': 63, '65': 64, '66': 65, '67': 66, '68': 67, '69': 68, '7': 69, '70': 70, '71': 71, '72': 72, '73': 73, '74': 74, '75': 75, '76': 76, '77': 77, '78': 78, '79': 79, '8': 80, '80': 81, '81': 82, '82': 83, '83': 84, '84': 85, '85': 86, '86': 87, '87': 88, '88': 89, '89': 90, '9': 91, '90': 92, '91': 93, '92': 94, '93': 95, '94': 96, '95': 97, '96': 98, '97': 99, '98': 100, '99': 101}}
{'1': 0, '10': 1, '100': 2, '101': 3, '102': 4, '11': 5, '12': 6, '13': 7, '14': 8, '15': 9, '16': 10, '17': 11, '18': 12, '19': 13, '2': 14, '20': 15, '21': 16, '22': 17, '23': 18, '24': 19, '25': 20, '26': 21, '27': 22, '28': 23, '29': 24, '3': 25, '30': 26, '31': 27, '32': 28, '33': 29, '34': 30, '35': 31, '36': 32, '37': 33, '38': 34, '39': 35, '4': 36, '40': 37, '41': 38, '42': 39, '43': 40, '44': 41, '45': 42, '46': 43, '47': 44, '48': 45, '49': 46, '5': 47, '50': 48, '51': 49, '52': 50, '53': 51, '54': 52, '55': 53, '56': 54, '57': 55, '58': 56, '59': 57, '6': 58, '60': 59, '61': 60, '62': 61, '63': 62, '64': 63, '65': 64, '66': 65, '67': 66, '68': 67, '69': 68, '7': 69, '70': 70, '71': 71, '72': 72, '73': 73, '74': 74, '75': 75, '76': 76, '77': 77, '78': 78, '79': 79, '8': 80, '80': 81, '81': 82, '82': 83, '83': 84, '84': 85, '85': 86, '86': 87, '87': 88, '88': 89, '89': 90, '9': 91, '90': 92, '91': 93, '92': 94, '93': 95, '94': 96, '95': 97, '96': 98, '97': 99, '98': 100, '99': 101}
VGG(
  (features): Sequential(
    (0): Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
    (1): ReLU(inplace=True)
    (2): Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
    (3): ReLU(inplace=True)
    (4): MaxPool2d(kernel_size=2, stride=2, padding=0, dilation=1, ceil_mode=False)
    (5): Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
    (6): ReLU(inplace=True)
    (7): Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
    (8): ReLU(inplace=True)
    (9): MaxPool2d(kernel_size=2, stride=2, padding=0, dilation=1, ceil_mode=False)
    (10): Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
    (11): ReLU(inplace=True)
    (12): Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
    (13): ReLU(inplace=True)
    (14): Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
    (15): ReLU(inplace=True)
    (16): MaxPool2d(kernel_size=2, stride=2, padding=0, dilation=1, ceil_mode=False)
    (17): Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
    (18): ReLU(inplace=True)
    (19): Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
    (20): ReLU(inplace=True)
    (21): Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
    (22): ReLU(inplace=True)
    (23): MaxPool2d(kernel_size=2, stride=2, padding=0, dilation=1, ceil_mode=False)
    (24): Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
    (25): ReLU(inplace=True)
    (26): Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
    (27): ReLU(inplace=True)
    (28): Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
    (29): ReLU(inplace=True)
    (30): MaxPool2d(kernel_size=2, stride=2, padding=0, dilation=1, ceil_mode=False)
  )
  (avgpool): AdaptiveAvgPool2d(output_size=(7, 7))
  (classifier): Sequential(
    (fc1): Linear(in_features=25088, out_features=4096, bias=True)
    (relu): ReLU()
    (dropout): Dropout(p=0.2, inplace=False)
    (fc2): Linear(in_features=4096, out_features=2048, bias=True)
    (relu2): ReLU()
    (dropout2): Dropout(p=0.5, inplace=False)
    (fc3): Linear(in_features=2048, out_features=102, bias=True)
    (output): LogSoftmax(dim=1)
  )
)

Inference for classification¶

Now you'll write a function to use a trained network for inference. That is, you'll pass an image into the network and predict the class of the flower in the image. Write a function called predict that takes an image and a model, then returns the top $K$ most likely classes along with the probabilities. It should look like

probs, classes = predict(image_path, model)
print(probs)
print(classes)
> [ 0.01558163  0.01541934  0.01452626  0.01443549  0.01407339]
> ['70', '3', '45', '62', '55']

First you'll need to handle processing the input image such that it can be used in your network.

Image Preprocessing¶

You'll want to use PIL to load the image (documentation). It's best to write a function that preprocesses the image so it can be used as input for the model. This function should process the images in the same manner used for training.

First, resize the images where the shortest side is 256 pixels, keeping the aspect ratio. This can be done with the thumbnail or resize methods. Then you'll need to crop out the center 224x224 portion of the image.

Color channels of images are typically encoded as integers 0-255, but the model expected floats 0-1. You'll need to convert the values. It's easiest with a Numpy array, which you can get from a PIL image like so np_image = np.array(pil_image).

As before, the network expects the images to be normalized in a specific way. For the means, it's [0.485, 0.456, 0.406] and for the standard deviations [0.229, 0.224, 0.225]. You'll want to subtract the means from each color channel, then divide by the standard deviation.

And finally, PyTorch expects the color channel to be the first dimension but it's the third dimension in the PIL image and Numpy array. You can reorder dimensions using ndarray.transpose. The color channel needs to be first and retain the order of the other two dimensions.

In [115]:
from PIL import Image
def process_image(image):
    ''' Scales, crops, and normalizes a PIL image for a PyTorch model,
        returns an Numpy array
    '''
    
    # TODO: Process a PIL image for use in a PyTorch model
    pil_img = Image.open(image).convert('RGB')

    image_size = pil_img.size
    h = min(image_size)
    w = max(image_size)

    ratio_aspec = w/h

    x = image_size.index(min(image_size))
    y = image_size.index(max(image_size))

    new_image_size = [0, 0]
    new_image_size[x] = 256
    new_image_size[y] = int(new_image_size[x] * ratio_aspec)
    pil_img = pil_img.resize(new_image_size)

    width, height = new_image_size

    left_margin = (width - 224)/2
    top_margin = (height - 224)/2
    right_margin = (width + 224)/2
    bottom_margin = (height + 224)/2

    pil_img = pil_img.crop((left_margin, top_margin, right_margin, bottom_margin))

    np_image = np.array(pil_img)

    np_image = np_image/255
    mean = np.array([0.485, 0.456, 0.406])
    std = np.array([0.229, 0.224, 0.225])
    np_image = (np_image - mean)/std

    np_image = np_image.transpose((2, 0, 1))

    return np_image

To check your work, the function below converts a PyTorch tensor and displays it in the notebook. If your process_image function works, running the output through this function should return the original image (except for the cropped out portions).

In [116]:
def imshow(image, ax=None, title=None):
    """Imshow for Tensor."""
    if ax is None:
        fig, ax = plt.subplots()
    
    # PyTorch tensors assume the color channel is the first dimension
    # but matplotlib assumes is the third dimension
    image = image.numpy().transpose((1, 2, 0))
    
    # Undo preprocessing
    mean = np.array([0.485, 0.456, 0.406])
    std = np.array([0.229, 0.224, 0.225])
    image = std * image + mean
    
    # Image needs to be clipped between 0 and 1 or it looks like noise when displayed
    image = np.clip(image, 0, 1)
    
    ax.imshow(image)
    
    return ax
In [117]:
np_array = process_image(valid_dir + '/1/image_06739.jpg')
print(type(np_array))

t1_tensor = torch.from_numpy(np_array)
imshow(t1_tensor)
<class 'numpy.ndarray'>
Out[117]:
<Axes: >
No description has been provided for this image
In [118]:
with Image.open(valid_dir + '/1/image_06739.jpg') as image:
    plt.imshow(image)
No description has been provided for this image

Class Prediction¶

Once you can get images in the correct format, it's time to write a function for making predictions with your model. A common practice is to predict the top 5 or so (usually called top-$K$) most probable classes. You'll want to calculate the class probabilities then find the $K$ largest values.

To get the top $K$ largest values in a tensor use x.topk(k). This method returns both the highest k probabilities and the indices of those probabilities corresponding to the classes. You need to convert from these indices to the actual class labels using class_to_idx which hopefully you added to the model or from an ImageFolder you used to load the data (see here). Make sure to invert the dictionary so you get a mapping from index to class as well.

Again, this method should take a path to an image and a model checkpoint, then return the probabilities and classes.

probs, classes = predict(image_path, model)
print(probs)
print(classes)
> [ 0.01558163  0.01541934  0.01452626  0.01443549  0.01407339]
> ['70', '3', '45', '62', '55']
In [121]:
def predict(image_path, model, topk=5):
    ''' Predict the class (or classes) of an image using a trained deep learning model.
    '''
    
    # TODO: Implement the code to predict the class from an image file
    device = torch.device("cuda" if torch.cuda.is_available() else "cpu")

    model.eval()

    tensor = torch.from_numpy(process_image(image_path)).to(device, dtype=torch.float)
    print(tensor.shape)

    output = model.forward(tensor.unsqueeze_(0))

    probabilities = torch.exp(output)

    top_probabilities, top_classes = probabilities.topk(topk, dim=1)
    top_probabilities, top_classes = top_probabilities.cpu(), top_classes.cpu()

    class_to_idx_inverse = {model.class_to_idx[k]: k for k in model.class_to_idx}

    mapped_labels = []
    for label in top_classes.detach().numpy()[0]:
        mapped_labels.append(class_to_idx_inverse[label])

    return top_probabilities.detach().numpy()[0], mapped_labels
In [123]:
probs, classes = predict(valid_dir + '/1/image_06739.jpg', model2)
print(f'Prediction accuracies: {probs}')
print(f'Class prediction: {classes}')
torch.Size([3, 224, 224])
Prediction accuracies: [0.56938756 0.17867598 0.16066773 0.0305265  0.02000079]
Class prediction: ['1', '52', '51', '19', '83']

Sanity Checking¶

Now that you can use a trained model for predictions, check to make sure it makes sense. Even if the testing accuracy is high, it's always good to check that there aren't obvious bugs. Use matplotlib to plot the probabilities for the top 5 classes as a bar graph, along with the input image. It should look like this:

No description has been provided for this image

You can convert from the class integer encoding to actual flower names with the cat_to_name.json file (should have been loaded earlier in the notebook). To show a PyTorch tensor as an image, use the imshow function defined above.

In [136]:
# TODO: Display an image along with the top 5 classes
image_paths = [
    valid_dir + '/1/image_06739.jpg',
    valid_dir + '/1/image_06763.jpg',
    valid_dir + '/30/image_03487.jpg',
    valid_dir + '/30/image_03544.jpg',
    valid_dir + '/59/image_05034.jpg',
    valid_dir + '/59/image_05056.jpg',
    valid_dir + '/73/image_00378.jpg',
    valid_dir + '/73/image_00415.jpg',
    valid_dir + '/102/image_08006.jpg',
    valid_dir + '/102/image_08041.jpg',

]

def show_classifier_results(model, image_class, image_path):
    top_probabilities, top_classes = predict(image_path, model)

    label = cat_to_name[top_classes[0]]

    plot_figure, (ax1, ax2) = plt.subplots(figsize=(10, 6), ncols=2)
    ax1.set_title(label)
    ax1.imshow(Image.open(image_path))
    ax1.axis('off')

    labels = []
    for class_index in top_classes:
        labels.append(cat_to_name[class_index])

    y_pos = np.arange(5)
    ax2.set_yticks(y_pos)
    ax2.set_yticklabels(labels)
    ax2.set_xlabel('Class Probability')
    ax2.invert_yaxis()
    ax2.barh(y_pos, top_probabilities, xerr=0, align='center', color='blue')

    plt.show()
In [137]:
for image_path in image_paths:
    show_classifier_results(model, cat_to_name, image_path)
torch.Size([3, 224, 224])
No description has been provided for this image
torch.Size([3, 224, 224])
No description has been provided for this image
torch.Size([3, 224, 224])
No description has been provided for this image
torch.Size([3, 224, 224])
No description has been provided for this image
torch.Size([3, 224, 224])
No description has been provided for this image
torch.Size([3, 224, 224])
No description has been provided for this image
torch.Size([3, 224, 224])
No description has been provided for this image
torch.Size([3, 224, 224])
No description has been provided for this image
torch.Size([3, 224, 224])
No description has been provided for this image
torch.Size([3, 224, 224])
No description has been provided for this image

References¶

AIPNP Neural Network Lesson 4¶

Part 5 - Inference and Validation

Part 6 - Saving and Loading Models

Part 8 - Transfer Learning

Python & Miscellaneous¶

Objects and classes in Python

find the latest file in a folder

How to get the aspect ratio of an image?

Activation functions and its types

argparse

pil_image

In [ ]: